Data Engineer

This role is part of the Data Engineering team, to serve the data engineering needs for both social enterprises as well as a strategic project to identify and deliver on currently unserved family needs. We are looking for passionate data engineers to develop data analytic capabilities, from data infrastructure, ingestions, ETL/ELT data pipeline, to data modeling, you will be getting "first-hand" access to our engineer centralized data platform, working with high impact projects and interacting directly with senior leadership. Your voice and effort would be critical to the success of the data platform.

The ideal candidate is an experienced data wrangler or data enthusiast who enjoys optimizing data systems and solving problems through data, with extensive technical expertise in big data technology, data ingestion pipeline and data modeling.

He/she will be responsible for designing and managing data warehouse plans for a product or business line, designing, building and maintaining the batch or real time data pipeline in production using cloud big data technology, and working with the business team on transforming the raw data into actionable data mart.

Duties and Responsibilities

Set up data infrastructure, data pipelines, integrate source system data with data lakes and data mining models into data pipelines.

Design, build, support and optimize new and existing data models and ETL/ELT processes, including the ETL/ELT from source system to data lake and those within the data lake

Develop and support the data pipeline to integrate data from new data sources with emerging data technologies.

Define and manage SLA, data quality for all data sets in allocated areas of ownership

Maintain and optimize the performance of data analytics infrastructure to ensure accurate, reliable and timely delivery of key insights for decision making

JOB REQUIREMENTS

Bachelors/Masters in Computer Science Engineering or related field

Relevant work experience as Data Engineer or related field

Experience with Data Engineer or Data Analytics Infrastructure. 1-5 years' experience in designing, building and operationalizing medium to large scale data integration projects with Google cloud.

Familiarity with SQL and one or more data Lake, Data Warehouse, RDBMS technologies (e.g.,MSSQL, Oracle, SAP Hana, Hive, Bigquery, Redshift, etc.)

Able to work independently with large and multiple data sets from various businessprocesses and systems, to support the business in achieving strategic objectives

Strong interest in understanding and solving business problem with data

1-5 years of experience with python or any equivalent programming language

AWS or Google cloud knowledge and experience is a plus.

Skills

data miningapache hivebig dataproblem solvingdata managementdata qualitydata integrationamazon redshiftdesign managementgoogle cloud platformreliabilitysqldata analysiscomputer scienceleadershipdecision makingpythondata infrastructureownershipsap hanadata modelingwork independentlybigquerydata warehouseprogramming languagereportingontime deliveryservice-level agreementdata pipelinestechnical competencyactionable insightinformation engineeringetl tooldata importdata lakekey insightsrelational database management system