Lead Data Software Engineer
Office in Coimbatore
Data Software Engineering
& others
We are seeking a skilled Lead Data Software Engineer to join our dynamic team and address challenging and rewarding projects.
As a Lead Engineer, you will play a key role in designing and implementing data solutions across diverse initiatives. The ideal candidate will bring extensive expertise in Data and related technologies, with a strong focus on Apache Spark, Python, Azure, and AWS.
Responsibilities
- Design and implement comprehensive Data solutions for complex business challenges
- Collaborate with cross-functional teams to ensure project requirements are met with exceptional software solutions
- Leverage your expertise in Apache Spark, Python, Azure, and AWS to build scalable data processing workflows
- Ensure optimal performance, security, and scalability of Big Data applications
- Stay informed about emerging trends and innovations in Big Data technologies to continuously improve development practices
Requirements
- 8-12 years of experience working directly with Data and associated technologies
- Expertise in Apache Spark with hands-on application
- Proficiency in Python
- Competency in Hadoop and Hive
- Background in using native Cloud data services on AWS and Azure
Nice to have
- Background in machine learning algorithms and their applications
- Proficiency in tools for data visualization, such as Tableau or Power BI
- Knowledge of frameworks for real-time data processing like Apache Flink or Apache Storm
- Familiarity with containerization platforms including Docker or Kubernetes
Technologies
- Hadoop
- Hive