Data Engineer

Data Engineer

Description -

The Senior Data Engineer will design, build, and operate high-performance BI-centric solutions utilizing the comprehensive capabilities of the company's analytics platform. In this role, you will enable and support the intelligence strategy, support sustainable, effective, and efficient solutions, collaborate on data solutions, and support intellectual curiosity and continuous learning to meet individual and team development goals.

Applies advanced subject matter knowledge to solve complex business issues and is regarded as a subject matter expert. Frequently contributes to the development of new ideas and methods. Works on complex problems where analysis of situations or data requires an in-depth evaluation of multiple factors. Leads and/or provides expertise to functional project teams and may participate in cross-functional initiatives.

Job Type : Hybrid/Flexible work culture

Responsibilities

Leads one or more project teams of other data engineers for all stages of design and development for complex, secure, and performant data solutions and models, including design, analysis, coding, testing, and integration of structured/unstructured data.

Reviews and evaluates designs and project activities for compliance with architecture, security, and quality guidelines and standards; provides tangible feedback to improve product quality and mitigate failure risk.

Drives innovation and integration of new technologies into projects and activities in the big data space.

Create and maintain optimal data pipeline/ETL architecture.

Collaborate with businesses, application and process owners, and product team members to define requirements and design solutions for the company’s big data and analytics solutions.

Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Databricks and other technologies.

Perform data modeling and prepare data in databases for use in various analytics tools, and configure and develop data pipelines to move and optimize data assets.

Provide necessary technical support through all phases of the solution life cycle.

Independently handle complex issues with minimal supervision, while escalating only the most complex issues to appropriate staff

Knowledge & Skills

Must Have

Databricks for data engineering, analytics, and machine learning workflows

Python and SQL programming and advanced ETL pipelines

Lakeflow and Spark-based big data processing and orchestration on Databricks

GitHub, CI/CD, Databricks Asset Bundles, and modern software engineering practices applied to data engineering

Strong analytical and problem-solving skills

Nice to Have

BI and reporting tools (Tableau)

Collaboration and Agile (Jira, Confluence, Scrum, Kanban)

Experience with NoSQL and relational systems

A current Databricks Certified Data Engineer certification

Team Leadership and Data Ops skills

Experience Highlights

Designing and deploying scalable data solutions on Databricks and cloud ecosystems

Building and optimizing distributed data pipelines for complex, high-volume environments

Implementing BI solutions and enabling data-driven decision-making

Communicating architecture and design proposals effectively to senior stakeholders

Working at a complex, high-stakes, startup-like environment

Scope & Impact

Collaborates with peers, Data engineers, data scientists, and the project team.

Typically interacts with high-level Individual Contributors, Managers, Directors, and Program Core Teams.

Leads multiple projects requiring data engineering solutions development.

Prior Beneficial Experiences

Experience and skills with application programming interface development.

Applied experience in reporting tools.

Applied experience with cloud platforms.

Education & Experience

Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or equivalent.

Typically 3-7 years’ experience.

#LI-POST

Job -

Data & Information Technology

Schedule -

Full time

Shift -

No shift premium (India)

Travel -

Relocation -

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.