Pyspark Engineer Job at Trinity Technology Solutions LLC, Charlotte, NC

cGRGOHExemtCVEZRNXMrM3dYNi9aMmRzQWc9PQ==
  • Trinity Technology Solutions LLC
  • Charlotte, NC

Job Description

Job Description:

Our client is seeking a highly skilled and experienced Senior PySpark Developer to join our dynamic data engineering team. This role is ideal for a motivated professional with a strong background in big data technologies, ETL processes, and database systems. The successful candidate will play a key role in designing, developing, and optimizing data pipelines and analytics solutions that support critical business operations.

📌 Note: Only candidates eligible to work on a W2 basis will be considered.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using PySpark and Spark SQL.
  • Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver robust solutions.
  • Optimize and troubleshoot complex ETL workflows and data transformation processes.
  • Write efficient SQL queries for data extraction, transformation, and loading.
  • Ensure data quality, integrity, and compliance with enterprise standards.
  • Participate in code reviews, testing, and deployment activities.
  • Monitor and maintain production workflows, including job scheduling and performance tuning.

Required Skills & Qualifications:

  • 5+ years of experience in data engineering or software development.
  • Strong proficiency in PySpark, Python, and Spark SQL.
  • Solid experience with SQL and relational database systems.
  • Proven expertise in ETL development and data pipeline orchestration.
  • Familiarity with job scheduling tools; Autosys experience is a plus.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration abilities.

Preferred Qualifications:

  • Experience working in the financial services industry.
  • Familiarity with cloud platforms and big data ecosystems.

Job Tags

Similar Jobs

Civility Home Care

Personal Care Aide (PCA) Job at Civility Home Care

We are hiring compassionate Caregivers, Personal Care Attendants, and Live Ins to work in homecare settings. We are proud to offer you the opportunity to pursue your passion for flexible schedules. Come work for us and see how Civility Home Care staff provide quality care...

Midwest Logistic Systems

New Business - Midwest Logistics Systems Dedicated truck driver Job at Midwest Logistic Systems

 ...with onsite leaders and dispatch. Pay and bonus potential ~ Route and detention pay. ~$5,000 sign-on bonus for experienced drivers. ~ Safety and performance bonuses of up to $600 per quarter. ~ Longevity bonus of up to $750 per quarter. ~ Weekly paychecks.... 

Element Staffing Services

R&D Chemist (Inks & Coatings) Job at Element Staffing Services

 ...General Summary: The R&D Chemist is responsible for the formulation of innovative products in the US including all chemistries and Graphic Arts market segments. These chemistries include UV and aqueous inks, coatings and adhesives and fountain solutions for lithographic... 

U.S. Tsubaki Power Transmission, LLC

Production Operator (UH) - 2nd Shift Job at U.S. Tsubaki Power Transmission, LLC

 ...available in the world and we strive to be the Best Value supplier in the industry. Essential Duties and Responsibilities: Operate a wide range of machinery to fabricate, process, and assemble chain and other operations associated to ensure that all processes... 

The Gallery at Spokane

Full-Time Med Tech Job at The Gallery at Spokane

 ...approved COVID-19 vaccination, as well as any subsequent booster doses, as recommended by the Centers for Disease Control and Prevention (CDC). To facilitate and further encourage COVID-19 vaccinations, Stellar periodically organizes onsite vaccination clinics at its various...