You are viewing a preview of this job. Log in or register to view more details about this job.

Senior Specialist Cloud Data Engineer

Association of Public Health Laboratories
Email

Salary

$113,000 - $125,000

Position Summary

We are searching for a dynamic and seasoned Senior Cloud Data Engineer to spearhead our technological transformation, playing a pivotal role in redefining our approach to technology delivery, data governance, data architecture, data integration and information dissemination across APHL departments and for our members. This position demands a blend of technical acumen and leadership, poised to make a significant contribution to our cloud adoption journey and enhance APHL’s Agile/DevOps practices. The ideal candidate will collaborate closely with diverse internal and external partners and members, ensuring seamless integration and alignment with our strategic objectives.

Reporting directly to the Data Science Manager within the Quality Systems and Analytics (QSA) Department, the Senior Specialist will lead by example and drive innovation and efficiency at the forefront of our cloud data engineering initiatives.

Duties & Responsibilities

1.     Strategic Migration and Modernization Initiatives:

  • Lead the strategic migration of various online platforms and systems to Azure, ensuring a smooth transition while modernizing and automating the existing technological landscape.
  • Drive the transition to cloud-based solutions, facilitating centralized access across diverse domains, enhancing operational efficiency, and promoting innovation.

2.     Collaborative Data Solutions Development:

  • Work closely with data scientists, analysts, and other key partners to deeply understand data requirements and craft tailored solutions that meet these needs effectively.
  • Act as a pivotal liaison, fostering collaboration and ensuring the delivery of high-quality data solutions that support decision-making and strategic initiatives.

3.     Cloud Infrastructure Development and Management:

  • Engage in developing, migrating, and validating cloud-based systems, focusing on achieving seamless integration with existing environments and external systems.
  • Offer expert guidance to develop teams on constructing robust architectures and secure designs for applications and data services, ensuring best practices in security are always a priority.

4.     Performance Optimization and Technical Leadership:

  • Lead the technical aspects of application migration, focusing on enhancing technical reliability, optimizing performance, and integrating applications seamlessly with cloud services and other platforms.
  • Implement and manage cost-effective cloud solutions, aligning with usage patterns, business needs, and budget constraints, ensuring an optimal balance between performance and cost.

5.     Innovation in Machine Learning Infrastructure:

  • Design and oversee the implementation of machine learning infrastructures on the Azure cloud platform, aligning with the goals of APHL and its members to drive forward-looking initiatives.
  • Support the data science team in developing and refining predictive models, addressing the diverse and evolving needs of APHL and its membership.

6.     Operational Excellence and Continuous Improvement:

  • Monitor, identify, and troubleshoot issues within the data infrastructure, addressing performance bottlenecks and ensuring high availability and reliability.
  • Stay at the forefront of Azure cloud technologies, continually adopting the latest features and best practices in cloud data management to enhance our cloud data engineering capabilities.

Employment Standards - Education and Experience

  • Minimum Requirement: Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field from an accredited institution.
  • Preferred: Advanced degree (Master’s or higher) in Computer Science, Data Science, or a related field.
  • At least 5 years of professional experience in data engineering or a closely related field, with at least 3 years focused specifically on cloud environments, preferably Azure. This experience should include hands-on work with cloud data services (like Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake), database management, and the implementation of large-scale data processing architectures.

Knowledge, Skills, and Abilities

Technical Expertise:

  • Proficiency in Python and experience with Azure data services including Azure Data Factory, Azure Synapse Analytics, SQL Server, Azure Functions, and Azure Data Lake.
  • Demonstrable experience with SQL and NoSQL databases, including expertise in data modeling, performance optimization, and managing large/complex datasets.
  • Strong foundation in cloud infrastructure on Microsoft Azure, including Virtual Machines, Storage, Networking, and Security.
  • Experience with CI/CD pipelines (Azure Pipelines, Jenkins) and a solid track record in Agile/DevOps practices.
  • Familiarity with containerization technologies like Docker and Kubernetes.
  • Advanced skills in data visualization using Python (Seaborn, Plotly), JavaScript/HTML/CSS, or R.
  • Knowledge of application design principles, including code base layering, componentization, and framework selection. Experience with REST, Microservices, and React is a plus.
  • Proven ability to build applications and/or deploy machine learning models on Azure, utilizing tools such as Azure Machine Learning, Azure Data Factory, and Azure Synapse.
  • Proficient in version control using Git.

Skills:

  • Strong interpersonal skills with an emphasis on excellent verbal and written communication.
  • Work independently and build strong interdepartmental relationships.
  • Demonstrated problem-solving and advanced troubleshooting ability, with a keen eye for driving to the root cause of issues.
  • Solid understanding of information security, data sensitivity, and compliance frameworks relevant to cloud and data engineering.
  • An agile mindset with an understanding of the SCRUM process and the ability to adapt in a fast-paced development environment.

Certifications and Other Requirements:

  • Azure Data Engineer Certification is highly desirable.
  • Experience in networking, security, and identity management within Azure.
  • Experience designing, implementing, and maintaining critical cloud infrastructure for high-availability applications.

APHL Weeks:

APHL Week is a Conference/Convention that is held at the APHL Home Office Bethesda, MD. This event is mandatory for all employees to attend. Travel and lodging will be reimbursed by APHL.

Please Note: Reimbursement for travel and lodging may not be possible for employees that are local to the APHL Home Office.

Position Description Status:

The duties and responsibilities listed in this job description are illustrative ones anticipated for this position. Other duties and responsibilities may be assigned as required. Association of Public Health Laboratories (APHL) reserves the right to amend or change this job description to meet the needs of its programs. This job description and any attachments do not constitute or represent a contract.

Work Environment:

Work environment characteristics described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations will be made for known physical or mental limitations to enable individuals with disabilities to perform the essential functions of the role.

Physical Demands:

The physical demands described here are representative of those that must be met by a colleague to successfully perform the essential functions of this job. Reasonable accommodations will be made for known physical or mental limitations to enable individuals with disabilities to perform the essential functions of the role.
During the job, the colleague may need to sit for extended periods, use a computer keyboard to type, read information visually, and communicate orally through a computer monitor.

Equal Opportunity Employment Statement:

APHL is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, creed, sex, national origin, ancestry, citizenship status, sexual orientation, gender identity, marital status, veteran status, disability, age, genetic information or any other characteristic protected by applicable law.