Lead Data Software Engineer

Office in Coimbatore

Data Software Engineering

We are seeking a skilled Lead Data Software Engineer to join our dynamic team and address challenging and rewarding projects.

As a Lead Engineer, you will play a key role in designing and implementing data solutions across diverse initiatives. The ideal candidate will bring extensive expertise in Data and related technologies, with a strong focus on Apache Spark, Python, Azure, and AWS.

Responsibilities

Design and implement comprehensive Data solutions for complex business challenges
Collaborate with cross-functional teams to ensure project requirements are met with exceptional software solutions
Leverage your expertise in Apache Spark, Python, Azure, and AWS to build scalable data processing workflows
Ensure optimal performance, security, and scalability of Big Data applications
Stay informed about emerging trends and innovations in Big Data technologies to continuously improve development practices

Requirements

8-12 years of experience working directly with Data and associated technologies
Expertise in Apache Spark with hands-on application
Proficiency in Python
Competency in Hadoop and Hive
Background in using native Cloud data services on AWS and Azure

Nice to have

Background in machine learning algorithms and their applications
Proficiency in tools for data visualization, such as Tableau or Power BI
Knowledge of frameworks for real-time data processing like Apache Flink or Apache Storm
Familiarity with containerization platforms including Docker or Kubernetes

Technologies

Hadoop
Hive