Lead Data Software Engineer

Office in Chennai

Data Software Engineering

We are looking for a skilled Lead Data Software Engineer to join our innovative team and address exciting technical challenges.

As a Lead Engineer, you will play a key role in designing and delivering advanced Data solutions for diverse projects. The successful candidate will have extensive expertise in Data technologies, with a strong focus on Apache Spark, Python, Azure, and AWS.

Responsibilities

Deliver end-to-end Data solutions tailored to complex business requirements
Collaborate with cross-functional teams to interpret project objectives and deliver high-quality software solutions
Leverage expertise in Apache Spark, Python, Azure, and AWS to create robust and scalable data processing systems
Ensure optimal performance, security, and scalability of Big Data applications
Stay informed about industry advancements and emerging trends in Big Data technologies to refine development practices

Requirements

8–12 years of substantial experience in Data and related technologies
Expertise in Apache Spark with extensive hands-on experience
Proficiency in Python
Competency in Hadoop and Hive
Familiarity with native Cloud data services, primarily AWS and Azure

Nice to have

Background in applying machine learning algorithms and techniques
Competency in data visualization tools such as Tableau or Power BI
Knowledge of real-time data processing frameworks like Apache Flink or Apache Storm
Familiarity with containerization technologies including Docker or Kubernetes

Technologies

Hadoop
Hive