Loading...
Loading...

Senior Data Engineer

Posted by Kavimani V

Job Overview

We are seeking a talented Senior Data Engineer to join our growing data team. You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that power our data-driven decision-making processes.

Responsibilities

Design, develop, and maintain robust data pipelines using Python, PySpark, and Hadoop ecosystem Build and optimize complex SQL queries and stored procedures for data extraction and transformation Implement ETL/ELT processes to integrate data from multiple sources Develop and maintain data warehousing solutions and ensure data quality and integrity Collaborate with data scientists, analysts, and business stakeholders to understand data requirements Optimize data processing workflows for performance and scalability Monitor and troubleshoot data pipeline issues and implement solutions Establish best practices for data engineering and mentor junior team members Work with cloud platforms (AWS/Azure/GCP) for data storage and processing

Requirements

5-8 years of hands-on experience in data engineering roles Strong proficiency in Python for data processing and automation Extensive experience with Hadoop ecosystem (HDFS, Hive, MapReduce) Expert-level knowledge of PySpark for large-scale data processing Advanced SQL skills with experience in query optimization Experience with data warehousing concepts and dimensional modeling Strong understanding of ETL/ELT design patterns and best practices Familiarity with version control systems (Git) and CI/CD practices Experience with cloud platforms (AWS/Azure/GCP) is a plus Excellent problem-solving and analytical skills Strong communication and collaboration abilities

Skills & Competencies

Mandatory Skills   

  • Hadoop
  • PySpark
  • Python
  • SQL

Job Benefits

Education

Job details

Job Status
Cancelled
Location
Bengaluru, Karnataka, India
Experience
5 - 8 years
Employment Type
Permanent
Salary
₹2,000,000 - ₹3,000,000 (Annual)
Mode of work
Work from home (Remote)
No. of Positions
10
Work Type
Full-time

Company Info

Company Full Name
Nicheton Consulting LLP
Company Short Name
Nicheton
Industry
Recruitment & Staffing
Company size
24
Founded on
06-Feb-2018
Location
Bengaluru, Karnataka
Presence in
1 Country

Recommended Job Vacancies

Discover similar job openings and career opportunities that match your skills and experience. Apply Now!

.........Loading Jobs