Loading...
Loading...

Senior API Data Engineer

Posted by Kavimani V

Job Overview

We are looking for an experienced API Data Engineer / Cloud Developer with strong expertise in building secure, scalable, and event-driven solutions on AWS. The ideal candidate will play a key role in transforming legacy on-prem systems to cloud-native, serverless architectures using services like AWS Glue, Lambda, Step Functions, RDS (Aurora), and API Gateway. This is a high-impact development role, not a maintenance or enhancement position.

Responsibilities

• Design and develop RESTful APIs using AWS Lambda and Python, including secure API-to-API and API-to-application communication. • Build event-driven architectures that respond to file uploads in S3, triggering a pipeline of Glue jobs with quality checks and conditional processing. • Translate complex SQL Server stored procedures into modular, reusable AWS Glue (PySpark) jobs with dependency chaining using Step Functions. • Implement data quality checks and preprocessing logic directly in S3 using PySpark before triggering downstream processing. • Ensure end-to-end data pipeline security through AWS services such as KMS, tokenization, and secure access control. • Develop reusable libraries and components to streamline Glue development. • Monitor and log job executions using CloudWatch, implement alerting for job failures or performance issues. • Collaborate with cross-functional teams including architecture, DevOps, business analysts, and data consumers to deliver production-ready solutions. • Drive infrastructure-as-code practices using Terraform to provision API and data services.

Requirements

• 5+ years of experience building enterprise-scale, cloud-native applications in AWS. • Strong hands-on experience with AWS Glue, PySpark, Lambda, S3, Athena, and RDS (Aurora/Postgres). • Proven experience in building secure REST APIs, including token-based security, API Gateway configuration, and monitoring. • Experience working in event-driven and domain-driven architectures. • Deep knowledge of SQL Server and experience translating complex stored procedures to AWS Glue. • Expertise in designing modular, fault-tolerant Glue workflows using Step Functions. • Proficient in Python and developing reusable code libraries for data processing tasks. • Strong understanding of AWS security services (KMS, tokenization, IAM policies). • Experience with CloudWatch, monitoring, alerting, and log tracing. • Hands-on experience with Terraform for managing infrastructure as code. • Experience with API documentation and lifecycle management

Skills & Competencies

Mandatory Skills   

  • API
  • AWS Lambda
  • Glue
  • Python
  • S3

Job Benefits

Education

Job details

Job Status
Cancelled
Location
Hyderabad, Telangana, India
Experience
3 - 10 years
Employment Type
Permanent
Salary
₹1,500,000 - ₹1,900,000 (Annual)
Mode of work
Hybrid (Home and Office)
No. of Positions
-
Work Type
-

Company Info

Company Full Name
Nicheton Consulting LLP
Company Short Name
Nicheton
Industry
Recruitment & Staffing
Company size
24
Founded on
06-Feb-2018
Location
Bengaluru, Karnataka
Presence in
1 Country

Recommended Job Vacancies

Discover similar job openings and career opportunities that match your skills and experience. Apply Now!

.........Loading Jobs