Data Engineer Job at Qode, Texas

L2hUNDBKUCtsNDZWbUpZMDhMYlZCUmhmd0E9PQ==
  • Qode
  • Texas

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:

  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.

Preferred Qualifications:

  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Full time,

Similar Jobs

SVA System Vertrieb Alexander GmbH

Cyber Security Consultant - XDR (m/w/d) Job at SVA System Vertrieb Alexander GmbH

 ...sungen zu entwickeln, die schon heute in die Zukunft reichen und sich langfristig bewhren.Verstrken Sie unser Team als Cyber Security Consultant - XDR (m/w/d) an einem unserer Standorte deutschlandweit.Als Cyber Security Consultant mit Schwerpunkt XDR (m/w/d) sind... 

Addison Kenway.

Psychiatry Physician - Psychiatrist Job at Addison Kenway.

 ...Paid Vacations, Holiday Leave, Sick Leave and more. Open to experienced psychiatrists Board certified or board eligible in psychiatry Active or eligible for New York State medical licensure Brooklyn offers a richly diverse and vibrant urban community within... 

Pace Analytical Services

Sales Account Executive Job at Pace Analytical Services

 ...the health and safety of our communities and lives. Sales Account Executive This is a remote Sales Account Executive...  ...complex analysis, interpretation and counsel to customers, staff, management, and functional leaders regarding sales policies, programs and... 

Hire Energy

CNA's needed for PRN Shifts (Day and Night Shifts) in Arkansas Job at Hire Energy

 ...IMMEDIATE NEED FOR CNA's AT AHC. Day and Night PRN Shifts available! Certified Nursing Assistant (CNA) Arkansas Health Center (Benton, AR) Location: Benton, Arkansas (Saline County) Facility: Arkansas Health Center State-operated long-term care facility... 

Monarch Landscape Companies

Irrigation Production Manager Job at Monarch Landscape Companies

 ...professionalism leads to autonomy!JOB SUMMARY:Support and enhance Branch Irrigation revenue through bid preparation and sales assistance, and the...  ...development of Irrigation Techs. Reports to Irrigation Branch Manager; Leads and trains Irrigation Technicians; Participates in...