Data Engineer

10 hours ago

Bengaluru North Karnataka India, IN CentricaSoft Full time

Title: Data Engineer - PySpark

About CentricaSoft:

CentricaSoft is a data-driven technology partner delivering end-to-end data solutions for our clients. We design, build, and scale modern data platforms that empower business decisions. We’re growing our data engineering team and seeking a hands-on PySpark Developer who thrives in a fast-paced, collaborative environment.

Role Summary

We are looking for a PySpark Developer with solid AWS or Azure or GCP experience and in-depth knowledge of CI/CD pipelines with Parquet/JSON/Avro/Iceberg/Databricks. The candidate will work on multiple ETL data processing integrations, including API data pulls, Database extracts, and handling semi-structured data. Strong SQL skills and excellent communication are essential.


Atleast 1 Cloud certification from AWS (preferable) or Azure or GCP in Data Engineer area,


Key Responsibilities

  • Develop, optimize, and maintain PySpark-based data processing pipelines for large-scale data workloads.
  • Design and implement ETL/ELT processes, including API data ingestion, database extracts, and ingestion of semi-structured data (JSON, Parquet, Avro, etc.).
  • Build and maintain CI/CD pipelines for data engineering workloads (code, tests, deployments, and monitoring) with data quality checks, logging, and error handling to ensure robust data pipelines.
  • Optimize SQL queries and data models for performance and scalability.
  • Contribute to documentation, best practices, and knowledge sharing within the team.


Qualifications

  • 2-5 years of hands-on experience in data engineering.
  • Proficiency in PySpark and Spark-based data processing with Parquet/JSON/Avro/Iceberg/Databricks.
  • Solid cloud experience (AWS or Azure or GCP) with data services (e.g., AWS Glue/SageMaker, EMR/Redshift; Azure Data Factory/Databricks; GCP BigQuery/Dataflow/Dataproc, AirFlow, etc).
  • Strong understanding of CI/CD concepts and experience implementing pipelines (e.g., Git, CI servers, containerization, automated testing, deployment automation).
  • Deep SQL expertise (query tuning, performance optimization, complex joins, window functions).
  • Excellent communication skills and ability to collaborate with cross-functional teams.
  • Familiarity with big data processing frameworks, data modeling, and data governance concepts.


Certifications:

Atleast 1 Cloud certifications from AWS or Azure in Data Engineer area,


Nice-to-have

  • Experience with streaming data (Kafka/Kinesis), and real-time processing.
  • Knowledge of data visualization or BI tools (Power BI, Tableau) is a plus.

What We Offer

  • Hybrid work culture with a mix of on-site and remote work
  • Competitive salary and comprehensive benefits
  • Flexible work arrangements and a supportive, collaborative team
  • Opportunities to work on impactful, scalable data platforms
  • Professional development support and certification encouragement

  • Data Engineer

    10 hours ago

    india, IN Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%) Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    10 hours ago

    india, IN Bahwan CyberTek Full time

    Job Title: Data Engineer – Google Cloud Platform (GCP) Job Summary We are seeking a skilled and motivated Data Engineer with hands-on experience in building scalable data pipelines and cloud-native data solutions on Google Cloud Platform. The ideal candidate will be proficient in GCP services like Pub/Sub, Dataflow, Cloud Storage, and BigQuery, with a...

  • Data Engineer

    10 hours ago

    Bangalore Urban, Karnataka, India, IN Synechron Full time

    Good-day,We have immediate opportunity for Data Engineer (Python, Spark/Scala).Job Role: Data Engineer (Python, Spark/Scala)Job Location: Bangalore Experience-5 to 10 yearsNotice Period: Immediate joiner only.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...

  • Data Engineer

    10 hours ago

    Bangalore Urban, Karnataka, India, IN SatSure Full time

    As a Data Engineer specializing in geospatial data, your primary responsibility is to design, build, and maintain data infrastructure and systems that handle geospatial information effectively. You will work closely with cross-functional teams, including data scientists, geospatial analysts, and software engineers, to ensure that geospatial data is...

  • Data Engineer

    10 hours ago

    india, IN Canopus Infosystems - A CMMI Level 3 Company Full time

    Position: Data EngineerExperience: 2+ YearsLocation: RemoteJoining: Immediate Joiners PreferredAbout the Role:We are looking for a skilled Data Engineer with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing web...

  • Data Engineer

    10 hours ago

    india, IN Randstad Enterprise Full time

    Role : Data EngineerLocation : RemoteShift Timing : 2:00 Pm - 11:00 PmExperience : 2- 4 years relevant only ( this is a Junior position with us )Must have skillset :GCP - 2 years minimum working Experience Python and Pyspark - 2 yearsSQL - 2 yearsExcellent communicationWorked with global stakeholdersWho we are:Randstad Sourceright’s global talent solutions...

  • Data Engineer

    10 hours ago

    india, IN Talogy Full time

    Data EngineerThis opportunity is ideal for a determined and proactive individual who has a wide range of skills in a variety of database administration, reporting and dashboarding disciplines. This role requires an analytical thinker who pays significant attention to detail in their work.We are looking for an experienced data engineer with extensive...

  • Senior Data Engineer

    10 hours ago

    Bangalore Urban, Karnataka, India, IN USEReady Full time

    Job Title: Senior Databricks EngineerExperience Level: 5-8 YearsJob SummaryAs a Senior Databricks Engineer, you will be responsible for designing, developing, and optimizing our data architecture and pipelines on the Databricks Lakehouse Platform. You will leverage your deep expertise in Spark, Delta Lake, and cloud technologies to build scalable and...

  • Data Engineer

    10 hours ago

    india, IN Vriba Solutions Full time

    Role: Data Engineering Remote Looking for 5-10 years of Exp• Design, develop & maintain ETL/ELT pipelines• Ingest & transform data from APIs, DBs, files, streams• Build real-time & batch processing solutions• Data validation, quality & cleansing• Translate business needs into data models• Ensure data security, access control & compliance•...

  • Senior Data Engineer

    10 hours ago

    india, IN CareerXperts Consulting Full time

    We are looking for a highly skilled Senior Data Engineer to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will have strong expertise in modern data engineering tools and frameworks, along with the ability to collaborate closely with data scientists, analysts, and product teams to deliver reliable and efficient...