Job Description

Concord isn't your typical consulting firm; we're an execution-focused company passionate about delivering results. Our mission is to help clients enhance customer experiences, optimize operations, and revolutionize product offerings through seamless integration, optimization, and activation of technology and data.

We are looking for a Senior Data Engineer with solid experience in Databricks and advanced data engineering concepts. The ideal candidate will have a strong background in data migration from complex on-premises data warehouses to cloud data platforms and a proven track record in data modernization projects. This role demands hands-on experience with modern data engineering tools and technologies, along with the ability to lead initiatives and mentor junior team members.

About The Role

• Lead Databricks Initiatives: Oversee and manage Databricks projects, including the implementation of Delta Live, Unity Catalog, and lakehouse architecture.
• Performance Optimization: Develop and implement performance optimization techniques to ensure efficient data processing and storage.
• Cloud Cost Management: Monitor and manage cloud costs associated with data engineering projects, ensuring cost-effective solutions.
• Gen AI Integration: Integrate generative AI models and solutions into data engineering workflows to enhance data processing and analytics capabilities.
• Data Migration: Lead data migration efforts from complex on-premises data warehouses to cloud data platforms, ensuring data integrity and minimal downtime.
• Data Modernization: Drive data modernization projects, leveraging the latest technologies and best practices to transform legacy systems.
• Modern DE Tech Stack: Utilize modern data engineering tools and technologies, including AWS Glue, Azure Data Factory, Fivetran, Spark, Python, and dbt.
• Implementation of Data Pipelines: Build and maintain robust data pipelines using SQL, Spark, and other relevant technologies.
• Job Scheduling: Develop and manage job scheduling processes to ensure timely and reliable data processing.
• Production Deployment: Create and execute production deployment plans and steps to ensure smooth transitions and minimal disruptions.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Documentation: Maintain comprehensive documentation of data engineering processes, architectures, and best practices.
• Mentorship: Provide guidance and mentorship to junior data engineers, fostering a culture of continuous learning and improvement.

Required Qualifications

• At least 8 years of experience in Data Engineering.
• Proven experience leading complex data migration and modernization initiatives.
• Strong hands-on expertise with Databricks and the modern data stack.
• Proficient in SQL, Spark, Python, and tools such as dbt, Fivetran, AWS Glue, and Azure Data Factory.
• Experience implementing cloud-native architectures and optimizing for performance and cost.
• Experience in consulting companies with client-facing roles. 

Desired Skills

• Experience across multiple cloud providers: AWS, Azure, GCP.
• Familiarity with both traditional and modern ETL tools: Fivetran, DBT, HVR, Qlik, DataStage, Informatica.
• Databricks certification is a plus. 

 

What We Offer

• Health, Dental, and Vision Insurance: Comprehensive coverage to support your well-being.
• Employer Contributions to Health Savings Accounts (HSA): Helping you save for medical expenses.
• Flexible Spending Accounts (FSA): Options for healthcare and dependent care expenses, plus a Lifestyle Spending Account (LSA).
• Disability Insurance: Short- and long-term coverage, fully paid by the employer.
• Life and AD&D Insurance: Employer-provided coverage, with options for additional voluntary coverage.
• Paid Time Off (PTO) and Holidays: PTO policy and paid company holidays.
• Employee Assistance Program (EAP): Access to personal and professional support resources.
• Career Growth Opportunities: Pathways for advancement and skill development.
• Team Engagement Activities: Regular team-building events and company-sponsored activities to foster collaboration and connection.

Additional Information

• Employment Type: Full-time, long-term position at Concord.
• Salary: $110,000 - $135,000.
• Location: Preferred Kansas City or Minneapolis with occasional visits to the office. Open to remote for others 
• Interview process: (1) introductory call, (2) technical interview, and (3) interview with the hiring manager. 
• Requirements: Must be legally authorized to work in the United States without company sponsorship, now or in the future.

***

More than just a consulting firm, Concord is an execution company helping clients enhance customer experience, optimize operations, and differentiate product offerings. From digital transformation and legacy modernization to domain-driven design, we deliver real solutions for the problems our clients face. Join one of the fastest growing consulting firms in the Midwest!

Our core capabilities work together to help companies untangle their toughest business and technology challenges: Business Strategy & Alignment, Digital & User Experience, Cloud Applications & Integration, Data Solutions & Analytics, Quality Engineering, and Information Security.

***

Job Tags

Full time, Temporary work, Work at office, Remote work, Flexible hours,

Similar Jobs