Job Description
Job Title: Lead Data Engineer
Location: Columbia, SC
Duration: 12 Months
Project Overview: The Data Operations Hub (DOH) functions as a centralized platform responsible for the ingestion, validation, transformation, security, and provisioning of enterprise data. It supports analytics, reporting, operational efficiency, and regulatory compliance.
Daily Duties & Responsibilities: As a System Software Programmer - Consultant , you will be a core member of the Data Operations Hub Team. This position focuses on designing and implementing analytical data solutions that align with the organization’s strategic objectives. The ideal candidate will have strong skills in data architecture, modeling, integration, and migration. You will work closely with cross-functional teams to execute modern, scalable data solutions.
Key Responsibilities:
Represent the Data Operations Hub team in cross-functional forums, offering guidance on data solutions.
Design and maintain scalable data architectures, including data lakes and data warehouses.
Collaborate with stakeholders to ensure solutions meet business requirements and support data-driven decision-making.
Evaluate and recommend emerging technologies for adoption.
Develop architectural models and related artifacts using tools like Sparx or equivalent.
Act as a subject matter expert in data-related domains.
Utilize modern data processing tools (e.g., Python, Java, Airflow) in a data mesh or data lake environment.
Participate in hands-on coding, testing, and deployment of production-grade data solutions.
Enhance system performance and resolve technical inefficiencies.
Create reusable data frameworks and adopt cutting-edge technologies.
Required Skills:
~3+ years in a Data Engineer or similar role, with leadership in solving complex technical challenges.
~3+ years hands-on experience with system design, Python application development, and system stability.
~3+ years experience in architecture and proficiency in Python and Java.
~2+ years experience in data modeling, data integration, and domain-driven design using cloud data services.
~2+ years experience with AWS or Azure cloud services and related data engineering tools.
~3+ years experience working with SQL, cloud-native relational databases, and data warehouse solutions (e.g., Snowflake, Athena, Postgres).
Preferred Skills:
AWS or Azure certification (Cloud Practitioner or Developer).
Experience working in a Medicaid or healthcare-related environment.
Job Tags
Similar Jobs
The University of Iowa
Full/Part Time Status:Full TimePosition Description:Clinical PsychiatristDepartment of PsychiatryThe Department of Psychiatry within the Carver College of Medicine at the University of Iowa Health Care is seeking a board certified or board eligible psychiatrist to...
Pattern Promotions
Join Our Team at Pattern Promotions - Entry Level Events AssistantAbout Us: In a rapidly changing world, innovation and creativity are essential... ...Assistant, you will play a crucial role in supporting the planning and execution of various events, ranging from corporate...
KCH Trucking
Class A Owner Operators Home on weekends JobOwner operators and Company Drivers needed!!!We're a small family owned and operated company... ...with Hazmat endorsement.2 years tractor trailer experienceMust be at least 23 years of ageNo age limit on truck, must...
Mangrum Career Solutions LLC
...Were hiring an experienced Human Resources Manager to lead HR at a fast-paced Food & Beverage manufacturing plant . This role is ideal for someone with union plant experience who can help stabilize the team, develop talent, and drive employee engagement as the site...
Nautical Ventures
...with or without notice. About Nautical Ventures: Make your passion your career. Nautical Ventures offers everything from yachts, boats, kayaks, stand-up paddleboards and water toys. Nominated as #17 dealer by Boating Industry magazine, Nautical Ventures is your...