Job Description
A long-term, low-cost provider of American-produced liquefied natural gas, with Louisiana-based export projects, services the global demand for North American natural gas and supports the development of clean and reliable North American energy supplies. Using reliable, proven technology in an innovative plant design configuration, this company's modular, mid-scale plant design replaces traditional designs, offering the same efficiency and operational reliability at significantly lower capital costs.
Data Engineer Position Overview Location: Arlington, VA
Reporting To: Director of Business Intelligence
Department: IT under the Vice President of Applications
Key Responsibilities and Essential Duties: - Build complex data solutions in an Azure Cloud environment.
- Maintain Azure components and services.
- Develop architecture changes using infrastructure as code.
- Create data architecture diagrams for complex data modeling solutions.
- Create and maintain data dictionaries to contextualize data from various sources.
- Enable end-to-end automation for deployment using continuous integration and continuous delivery.
- Implement data pipelines to ingest, standardize, and transform data into business-facing datasets.
- Perform unit and integration testing of data pipelines.
- Perform data integration at scale using Azure Data Factory.
- Utilize Databricks to transform, curate, and organize data for business intelligence reporting and analytics.
- Collaborate with BI developers and business SMEs to translate business requirements into curated datasets suitable for analytics solutions.
- Document data pipelines for maintainability.
- Work with source system and business owners to incorporate business changes into data pipelines.
- Design data architecture for future platform growth, including data warehousing, machine learning, streaming analytics, and data visualization.
- Assist in testing, governance, data quality, training, and documentation efforts.
- Actively engage in business stakeholder requirement workshops to understand, interpret, and translate requirements into effective technical solutions.
Job Qualifications: - Bachelor's degree in Computer Science, Data Analytics, Engineering, Mathematics, Business, or a related field.
- 2 years in cloud architecture and data engineering.
- Extensive experience in implementing data storage solutions, managing, developing data processing, and optimizing data solutions in Azure.
- Expertise in integrating, transforming, and consolidating data from structured and unstructured data systems for analytics solutions.
- Understanding of parallel processing and data architecture patterns.
- Proficient in data processing languages such as SQL, Python, or Spark.
- Experience in building secure data processing pipelines using Azure data services.
- Ability to self-manage and make independent decisions.
- Excellent interpersonal and communication skills, with strong critical thinking and attention to detail.
- Strong work ethic with the ability to prioritize effectively, meet deadlines, adapt to changing priorities and business needs, and succeed in a fast-paced environment.
- Excellent attention to detail and the ability to efficiently summarize and prioritize information.
Preferred Qualifications: - Proficient in Microsoft Azure Storage Explorer, Azure DevOps, Azure Data Factory, Azure Databricks, Azure Data Lake Gen 2, Unity Catalog, and Git.
- Experience in coding languages primarily Python and Spark.
- Experience in agile development and sprint planning.
- Strong technical writing skills.
This company is an Equal Opportunity Employer and does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status, or any other basis covered by appropriate law.
About Petroplan Petroplan is the trusted, specialist global Talent Solutions partner of choice for employers and professionals in the Energy sector. Since 1976, Petroplan has been here to help people like you make the most of the opportunities available and find the best fit for you as an individual.
Over 10,000 placements in more than 55 countries for over 550 clients across 65 disciplines.
In an industry where skilled and experienced professionals are increasingly sought after resource, we appreciate the true value of what you have to offer. What's more, we understand that different things are important to different people in today's world of work - it's about making exactly the right connections for you as an individual.
Our reputation for contractor and candidate care, understanding what makes you tick, and finding you the best match is second-to-none. We understand the industry inside-out and seek to understand YOU and your motivations in the same way. We take the time to evaluate your individual strengths, understand the most important things to you, and establish exactly what you're looking for from your next role.
Job Tags
For contractors,