backGo to search

Lead Data Software Engineer

Office in Coimbatore
bullets
Data Software Engineering
& others
bullets
hot

We are seeking a skilled Lead Data Software Engineer to join our dynamic team and address challenging and rewarding projects.

As a Lead Engineer, you will play a key role in designing and implementing data solutions across diverse initiatives. The ideal candidate will bring extensive expertise in Data and related technologies, with a strong focus on Apache Spark, Python, Azure, and AWS.

Responsibilities
  • Design and implement comprehensive Data solutions for complex business challenges
  • Collaborate with cross-functional teams to ensure project requirements are met with exceptional software solutions
  • Leverage your expertise in Apache Spark, Python, Azure, and AWS to build scalable data processing workflows
  • Ensure optimal performance, security, and scalability of Big Data applications
  • Stay informed about emerging trends and innovations in Big Data technologies to continuously improve development practices
Requirements
  • 8-12 years of experience working directly with Data and associated technologies
  • Expertise in Apache Spark with hands-on application
  • Proficiency in Python
  • Competency in Hadoop and Hive
  • Background in using native Cloud data services on AWS and Azure
Nice to have
  • Background in machine learning algorithms and their applications
  • Proficiency in tools for data visualization, such as Tableau or Power BI
  • Knowledge of frameworks for real-time data processing like Apache Flink or Apache Storm
  • Familiarity with containerization platforms including Docker or Kubernetes
Technologies
  • Hadoop
  • Hive