Senior Consultant - FSI
Infosys Singaporeand Australia
- Employment
- Full-time
- Seniority
- Senior
About the role
Data Technology Lead : Spark
Summary:
This role will be responsible for Leading a team for development, and maintenance of Spark, Hadoop and Hive applications.
The ideal candidate should have:
· Strong technology delivery experience with Spark, Python, Hive, Hadoop, and the Hadoop ecosystem. They will also be familiar with data modeling, data wrangling, and data analysis.
· Experience with both SAS and Python and will be able to work lead a team.
Responsibilities:
· Team Lead, develop, and maintain Pyspark and Hive applications.
· Work with data scientists and analysts to build data pipelines and data models.
· Optimize Pyspark and Hive queries for performance.
· Troubleshoot and debug Pyspark and Hive applications.
· Migrate SAS code to Python , deliver new Python applications.
· Document the migrated code.
· Work with other engineers to ensure the smooth transition to Python
Requirements
Qualifications:
· Bachelor's degree in computer science, data science, or a related field
· Experience with Spark, Python, SAS, Hive, Hadoop, and the Hadoop ecosystem
· Experience with data modeling, data wrangling, and data analysis
· Experience with cloud computing platforms (e.g., AWS, Azure, GCP)
· Strong problem-solving and analytical skills
· Excellent communication and teamwork skills
· Strong delivery skills, experience with data migration
We offer great opportunities within a dynamically growing consultancy. At Infosys Consulting you will discover a truly global culture, highly dedicated and motivated colleagues, a co-operative work environment and enriching training opportunities
758,000+ hidden jobs like this
Infosys Singaporeand Australia and thousands of companies post here first — often days before LinkedIn or Indeed. Your first 5 applications are free; go Pro to apply without limits.
Everything Pro unlocks:
- Unlimited applications — free stops at 5
- Track every application in one place
- Apply straight to the source, one click
- Save & organize roles you love
- Roles pulled from company boards before the big sites