This is a Senior Big Data Engineer / Data Platform Engineer role. It's a hands-on + leadership hybrid position — they want someone who can both build complex data pipelines and mentor/lead a team. It sits at the intersection of data engineering, architecture, and technical leadership.

• Highly capable in learning new technologies & frameworks and implementing them as per the project requirements by adhering to quality standards • Experience in all phases of data warehouse development lifecycle, from gathering requirements to testing, implementation, and support • Adept in analyzing information system needs, evaluating end-user requirements, custom designing solutions and troubleshooting information systems • Develop and implement data pipelines that extracts, transforms, and loads data into an information product that helps to inform the organization in reaching strategic goals • Investigate and analyze alternative solutions for data storage, processing etc. to ensure most streamlined approaches are implemented • Ensure operational resiliency of existing data pipelines by monitoring and resolving any issues. • Communicate, collaborate and work effectively in a global environment. • Lead projects through design, implementation, automation, and maintenance for large scale ETL processes supporting multiple business units • Leverage industry best practices including proper use of source control, participation in code reviews, data validation and testing • Implement best practices in Data Governance to ensure the data is available, usable and secure according to internal policies

• Must have experience deploying and working with big data technologies like Hadoop, Spark, and Sqoop • Experience with streaming frameworks like Kafka. • Experience designing and building ETL pipeline using NiFi • Highly proficient in OO programming (Python, PySpark Java, and Scala) • Experience with the Hadoop Ecosystem (HDFS, Yarn, MapReduce, Spark, Hive, Impala) • Proficiency on Linux, Unix command line, Unix Shell Scripting, SQL and any Scripting language • Proficiency on Linux, Unix command line, Unix Shell Scripting, SQL and any Scripting language