Senior Data Engineer
Employment Type: Full-Time
Senior Data Engineer Summary:
Signature Consultants has an opportunity for a Senior Data Engineer in Charlotte, NC. Our client is seeking a highly skilled data engineer who has a passion for all things data. The candidate will be responsible for data architecture, scripting, migrations and infrastructure to power scalable and user centric applications on our internal and external Cloud platforms. He/she will be an integral member of their product teams, working very closely with architects and software engineers on different layers of the infrastructure and design. Thus, a commitment to collaborative problem solving, sophisticated design, and product quality is essential.
Responsibilities Collaborate with application developers, database architects, data analysts and data scientists to ensure optimal data delivery architecture throughout ongoing projects/operations. Architect the complete project - provide solution architecture Develop, construct, test, and maintain architectures. Develop highly scalable data management interfaces, as well as software components by employing programming languages and tools. Support or collaborate with application developers, database architects, data analysts and data scientists to ensure optimal data delivery architecture throughout ongoing projects/operations. Develop highly scalable data management interfaces, as well as software components by employing programming languages and tools. Design, document, build, test and deploy data pipelines that assemble large complex datasets from various sources and integrate them into a unified view. Identify, design, and implement operational improvements: automating manual processes, data quality checks, error handling and recovery, re-designing infrastructure as needed. Build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications. Responsible for obtaining data from the System of Record and establishing batch or real-time data feed to provide analysis in an automated fashion. Apply technologies for responsive front-end experience Ensure systems meet business requirements and industry practices Research opportunities for data acquisition and new uses for existing data Integrate data management technologies and software engineering tools into existing structures Write SQL queries for adhoc analysis Write and maintain DDL and stored procedures Data Acquisition to collect the data from various sources Define the DataFlow Modularize the project components Employ a variety of languages and tools
Requirements: Must have experience leading teams to deliver complex products In addition to strong technical skills, must have strong communication skills Strong skills with business/stakeholder interactions Strong solutioning and Architecture skills Build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications. Responsible for obtaining data from the System of Record and establishing data feed to provide analysis in an automated fashion. Develop within security guidelines established SQL JSON BitBucket Workflow scheduling tools such as CA ESP Automation SQL Server DDL Stored Procedures Java Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets Ability to comprehend customer requests and provide the correct solution Understanding of distributed computing principles Strong analytical mind to help take on complicated problems Desire to resolve issues and dive into potential issues Familiarity with the Agile Methodology Experience with relational SQL databases, especially SQL Server. Experience with object-oriented languages, especially Java. Experience with data modeling Degree in Computer Science, Engineering, or related fields. 5-8 years of experience
About Signature Consultants, LLC
Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the 'Best Staffing Firms to Work For' and is now the 14th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit www.sigconsult.com. Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.* The salary listed in the header is an estimate based on salary data for similar jobs in the same area. Salary or compensation data found in the job description is accurate.
Loading some great jobs for you...