0319-001DE

Data Engineer

Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and objectives.

New York, Connecticut, Rohde Island, Massachusetts, or Texas

Contract, C2C

Short-Term

DOE

Apply now
Apply now

Job Description

Posted On:

September 4, 2024

Key Responsibilities

  • Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand data requirements and objectives.
  • Design and implement data extraction processes from various sources, including web APIs, PDF documents, Word files, Excel spreadsheets, and other structured and unstructured data formats.
  • Clean, preprocess, and transform raw data into structured formats that are suitable for downstream analytics and reporting.
  • Work on data enrichment techniques to enhance the quality and usability of the extracted data.
  • Document data extraction processes, transformations, and best practices for future reference.

Key Requirements

  • 5+ years of proven experience as a Data Engineer, with a strong record of accomplishment of working on data extraction, transformation, and loading processes.
  • Proficiency in Python, SQL and GCP is essential.
  • Prior experience in extracting data from web, PDF, Word, Excel, etc.
  • Prior experience in Web Scraping from Nested Tables, SharePoint, and other file format (Jason)
  • Prior experience in building complex pipeline (5-7 systems)
  • Solid understanding of ETL principles, data warehousing concepts, and data integration techniques.
  • Experience with data cleanup, data quality assessment, and data enrichment strategies.

Transform Your Business with Microagility

Let's Turn Your Challenges into Opportunities