Data Engineer
Skills
About the role
JOB OVERVIEW
Plan A Technologies is looking for a highly experienced and self-directed Data Engineer to spearhead the construction, optimization, and maintenance of our cloud-based distributed computing data pipelines. The successful candidate will be an expert "data wrangler" capable of understanding and optimizing complex data systems from the ground up.
In this capacity, you will serve as a critical technical partner to our software developers, data analysts, and data scientists, ensuring an optimal and consistent data delivery architecture across all ongoing projects. We are seeking a professional who is comfortable supporting the diverse data requirements of multiple teams, systems, and products simultaneously.
Please note: you must have at least 5+ years of experience in Engineering and Operationalizing Data Pipelines with large and complex datasets to be considered for this role.
JOB RESPONSIBILITY
Develop and operationalize scalable, reliable data pipelines to ensure seamless data flow.
Assemble large, complex datasets designed to meet both functional and non-functional business requirements.
Apply advanced techniques in database management, including logical data modeling, physical database optimization, and security protocols.
Continuously improve the integrity of data pipelines by implementing comprehensive Data Quality checks.
Partner with Data and Analytics experts to drive greater functionality and innovation within our data systems.
Provide On-Call support to identify and unblock user issues based on system severity.
EXPERIENCE
5+ years of experience in Engineering and Operationalizing Data Pipelines with large and complex datasets.
3+ years of professional experience working with unstructured data formats (JSON).
Extensive experience in Advanced SQL and 3+ years of experience with Python/PySpark.
3+ years of experience transforming data using Databricks and working within the AWS ecosystem.
Proven experience with GIT and CI/CD methodologies.
Proficiency with Power BI or similar data visualization platforms.
Excellent communication and collaboration skills.
Strong analytical, organizational, and detail-oriented mindset.
Excellent verbal and written English communication skills.
Initiative and drive to do great things.
ABOUT THE COMPANY/BENEFITS
Plan A Technologies is an American software development and technology advisory firm that brings top-tier engineering talent to clients around the world. Our software engineers tackle custom product development projects, staff augmentation, major integrations and upgrades, and much more. The team is far more hands-on than the giant outsourcing shops, but still big enough to handle major enterprise clients.
Location: Work From Home 100% of the time, or come in to one of our global offices. Up to you.
Great colleagues and an upbeat work environment: You'll join an excellent team of supportive engineers and project managers who work hard but don't ever compete with each other.
Benefits: Vacation, Brand New Laptop, and More: You’ll get a generous vacation schedule and other goodies.
If this sounds like you, we'd love to hear from you!
Questions about this role
Want AI Applyd to auto-apply to roles like this?
We tailor your resume per posting, fill the forms, and track replies for you.