Information Technology Consultant (AI Data Engineer (Cloudera to AWS Migration)

We are seeking a highly skilled AI & Data Science Engineer with strong expertise in Data Engineering, Machine Learning, and Generative AI technologies. The ideal candidate will have hands-on experience with Python, PySpark, Cloudera/Hadoop, AWS cloud services, and enterprise AI/ML platforms, along with proven experience migrating and modernizing data workloads from Cloudera to AWS. This role will focus on building scalable AI solutions, implementing GenAI applications, and productionizing machine learning models to drive business innovation and data-driven decision-making.

1. Design, develop, and deploy enterprise-scale AI, Machine Learning, and Generative AI solutions across cloud and hybrid environments.

2. Build and optimize scalable data processing frameworks using Python, SQL, Spark, and PySpark to support AI and analytics workloads.

3. Design and implement Retrieval-Augmented Generation (RAG) solutions leveraging embeddings, vector databases, and Large Language Models (LLMs).

4. Develop and deploy Machine Learning models, including feature engineering, model training, evaluation, and production deployment.

5. Collaborate with Data Engineering teams to migrate and modernize Cloudera/Hadoop workloads to AWS cloud platforms.

6. Build cloud-native AI/ML solutions using AWS services such as Sagemaker, Glue, EMR, Athena, Redshift, and S3.

7. Develop robust MLOps frameworks for model lifecycle management, CI/CD automation, monitoring, and governance.

8. Design scalable AI architectures that leverage enterprise data platforms while ensuring security, performance, and reliability.

9. Evaluate and integrate emerging AI, GenAI, and LLM technologies to enhance business capabilities and customer experiences.

10. Work closely with business stakeholders, architects, and engineering teams to translate business requirements into innovative AI-driven solutions.

11. Ensure AI models and applications meet quality, compliance, performance, and operational excellence standards.

Skills/Requirement

Strong Python, SQL and PySpark/Spark.

Strong Cloudera/Hadoop experience:

HDFS

Hive

Impala

Spark

CDP preferred

Strong AWS platform knowledge:

S3

Glue

EMR

Athena

Redshift

Sagemaker

Experience migrating or onboarding Cloudera workloads to AWS.

Data Science and Machine Learning:

Feature Engineering

Model Development

Evaluation

Deployment

GenAI and LLM experience:

RAG

Embeddings

Vector Databases

LLM Integration

MLOps:

CI/CD

Model Lifecycle Management

Monitoring

Preferred Skills

LangChain

Bedrock

OpenAI/Azure OpenAI

Pinecone/Weaviate/OpenSearch

Kubernetes

Financial Services domain knowledge

Interested candidates, who wish to apply for the above position, please send in your resume to: sasi.indurthi@persolapac.com

PERSOL Singapore Pte Ltd EA License No. 01C4394 EA Reg No: R1331594 (Sasi Indurthi Venkata)

We regret to inform you that only shortlisted candidates will be contacted.

*************************

This is in partnership with Employment and Employability Institute Pte Ltd (“e2i”). e2i is the empowering network for workers and employers seeking employment and employability solutions. e2i serves as a bridge between workers and employers, connecting with workers to offer job security through job-matching, career guidance and skills upgrading services, and partnering employers to address their manpower needs through recruitment, training, and job redesign solutions. e2i is a tripartite initiative of the National Trades Union Congress set up to support nation-wide manpower and skills upgrading initiatives. By applying for this role, you consent to e2i’s PDPA.

By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOL Singapore Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at https://www.persolapac.com.sg/policies. You acknowledge that you have read, understood, and agree with the Privacy Policy.

*************************