Data Engineer

GM Performance Power Units - Concord, NC Data Engineer - Onsite Job Summary Build and operate reliable data pipelines for power unit test and performance activities, using AWS as the primary cloud environment. Make engineering data accessible, traceable and ready for analysis, while retaining the context needed to interpret results correctly. Work with Test, Performance, Controls and IT teams to turn files, measurements and test events into supported data products. Collaborate with the business and manufacturing data role to connect test results with approved engine, build and component information in Microsoft Fabric. Key Responsibilities Build and maintain ingestion pipelines for agreed dyno, test rig, instrumentation and performance sources. Support batch, file and streaming patterns where requirements justify them. Preserve source files and relevant timestamps, units, calibration references, run identifiers and acquisition context. Implement validation and make missing or disputed context visible. Develop documented datasets and processing pipelines using Python and SQL. Implement duplicate prevention, late-data handling, checkpoints and controlled replay. Link test runs to approved engine, build and serialize component identities. Work with system owners to resolve mismatches and maintain traceable mappings. Prepare and publish agreed test and performance summaries from the AWS environment for use by the business and manufacturing data platform. Work with the business & manufacturing data engineer to establish controlled data exchanges, including the reference data needed to link test results to engines, builds and components. Monitor data freshness, pipeline failures, processing performance and cloud consumption. Tune storage, retention and compute against agreed engineering and cost requirements. Use source control, peer review, automated checks and controlled deployment. Maintain separate development and production configurations and protect credentials. Document pipelines, dependencies and recovery procedures. Train a nominated deputy and contribute to an agreed support and incident response model. Required Qualifications Practical experience building and supporting production data pipelines on AWS, including S3 and appropriate processing, orchestration and monitoring services. Strong Python and SQL skills, with experience handling large files, time-series data or other complex engineering datasets. Understanding of incremental processing, idempotency, schema changes, data quality controls and recovery from partial failure. Experience with Git, code review, testing and repeatable deployments. Ability to work with infrastructure as code and CI/CD practices. Understanding of cloud access controls, service identities, encryption and secure connectivity, working with infrastructure and security specialists. Ability to diagnose failures, explain cost drivers and document a service so another engineer can maintain it. Ability to translate engineering requirements into clear data contracts and acceptance tests, and communicate effectively with technical and business colleagues. Relevant qualification or equivalent practical experience. Candidates should demonstrate delivered outcomes rather than a specific certification alone. Preferred Qualifications Automotive, motorsport, aerospace, manufacturing or another test-intensive engineering environment. Dyno or rig data, signal alignment, timestamp synchronization, calibration context, telemetry formats and engineering metadata. Parquet or Delta Lake, distributed processing, and AWS services such as Glue, Athena, EMR, Kinesis or equivalent tools selected for the workload. Cross-cloud data exchange, Microsoft Fabric or Power BI integration, and linking test results to PLM, ERP or lifing records. Databricks on AWS where justified by the processing requirements. Databricks experience is beneficial rather than a prerequisite. Why Join Us Ready to be part of a team that pushes boundaries both on and off the track? At GM Performance Power Units, we are developing a new era of performance for the Formula 1 grid. Joining us means entering a startup racing environment backed by a legacy of engineering excellence, giving you the rare opportunity to help build a world-class program from day one. We believe in rewarding innovation and powering potential. As part of our team, you’ll benefit from a competitive and comprehensive package designed to support your performance, well-being, and future, helping you thrive at every level. That includes access to: Bonus scheme Private healthcare 401(k) plan including company match Employer-paid life insurance and disability coverage 32 days annual leave (including holidays) Free financial advisor access Employee Assistance Programs (EAP) Subsidized on-site dining On-site gym Discounted GM vehicle purchase/lease program Free on-site EV charging for personal GM vehicles It’s all part of our commitment to creating a workplace that’s as high-performing and forward-thinking as the people who make it succeed. Join us and help power what’s next. You’ll play a pivotal role in ensuring the reliability and performance of a next-generation Formula 1 power unit. Our culture rewards precision, innovation, and the relentless pursuit of performance. Please note: GM Performance Power Units and all affiliated companies are Equal Opportunity employer(s). Minorities, women, veterans, and individuals with disabilities are encouraged to apply. For more information regarding the EEOC, please visit https://www.eeoc.gov/employers/upload/poster_screen_reader_optimized.pdf. Only direct hires need apply to or inquire about job postings at GM Performance Power Units. We are not accepting calls, resumes or applications from recruiting firms at this time.