Digital: PySpark

1 week ago

New Delhi, India Tata Consultancy Services Full time

Greetings from TATA CONSULTANCY SERVICESTCS is hiring for PYSPARKLocation: - Chennai/BangaloreExperience Range: - 6- 12 yearsKey Responsibilities:- Develop, optimize, and maintain big data pipelines using PySpark on distributed computing platforms. - Design and implement ETL workflows for ingesting, processing, and transforming large datasets in Hive. - Work with structured and unstructured data sources to ensure efficient data storage and retrieval. - Optimize Hive queries and Spark jobs for performance, scalability, and cost efficiency. - Implement best practices for data engineering, including data governance, security, and compliance. - Monitor, troubleshoot, and enhance data workflows to ensure high availability and fault tolerance. - Work with cloud platforms Azure and big data technologies to scale data solutions.Required Skills & Qualifications:- Strong experience with PySpark for distributed data processing. - Hands-on experience with Apache Hive and SQL-based data querying. - Proficiency in Python and experience in working with large datasets. - Familiarity with HDFS, Apache Hadoop, and distributed computing concepts. - Good to have Knowledge of cloud-based data platforms like Azure Synapse, DataBricks - Understanding of performance tuning for Hive and Spark. - Strong problem-solving and analytical skills.

  • Looking for immediate joiners Digital: PySpark

    3 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    Experience: 6-8yearsLocation: MumbaiJob description of Digital : PySpark- Expertise and experience in Python and Pyspark (at least 4 years of experience) - Experience with BI tools, SQL queries, and organizing and analyzing data - Should have working knowledge and hands-on experience on the following Palantir Tools - Data Connection, Ontology, Code...

  • Data Engineer – Databricks

    2 weeks ago

    New Delhi, India Capgemini Engineering Full time

    Data Engineer – Databricks & PySpark Location:Bangalore Experience:6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...

  • PySpark & ETL Data Engineer

    2 weeks ago

    New Delhi, India CirrusLabs Full time

    We are CirrusLabs. Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...

  • Data Engineer – Databricks

    3 weeks ago

    New Delhi, India Capgemini Engineering Full time

    Data Engineer – Databricks & PySparkLocation: BangaloreExperience: 6–9 yearsChoosing Capgemini means choosing a place where you’ll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what’s possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the...

  • PySpark & ETL Data Engineer

    2 weeks ago

    New Delhi, India CirrusLabs Full time

    We areCirrusLabs . Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community. Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a...

  • Data Engineer with SQL/ETL/Pyspark

    2 weeks ago

    New Delhi, India Infosys Finacle Full time

    Mandate Skills - SQL, ETL ,hadoop, pyspark,Required SkillsPipeline/ETL (Extract, Transform, Load) processes, API integration, scripting languages (Python), and big data technologies (Trio, Iceberg, DuckDB/Parquet). Database design, data modeling, and data warehousing. SQL and at least one cloud platform. Analytical tools (Superset, Power BI), statistical...

  • Data Engineer with SQL/ETL/Pyspark

    2 weeks ago

    New Delhi, India Infosys Finacle Full time

    Mandate Skills - SQL, ETL ,hadoop, pyspark,Required Skills- Pipeline/ETL (Extract, Transform, Load) processes, API integration, scripting languages (Python), and big data technologies (Trio, Iceberg, DuckDB/Parquet). - Database design, data modeling, and data warehousing. SQL and at least one cloud platform. - Analytical tools (Superset, Power BI),...

  • Pyspark Architect-L

    3 days ago

    Delhi, Kolkata, Mumbai, NCR, India Infosys Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job descriptionHiring for Pyspark ArchitectMandatory Skills: PysparkEducation: BE/B.Tech/MCA/M.Tech/MSc./MSResponsibilitiesA day in the life of an InfoscionAs part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis,...

  • Data Engineer

    1 week ago

    New Delhi, India ACL Digital Full time

    Hi all, We are hiring for Data Engineer with one of our renowned client with pan India location. Looking for candidates with 5 to 7 years of experience Relevant5+ yearsinto Data Engineering GCP Cloud Data bricks, Unity catalog, Python/Pyspark Terra form scripts

  • Senior Data Engineer

    4 weeks ago

    New Delhi, India ACL Digital Full time

    Years of Exp: 5 to 8 years Notice Period: Immediate Location: PuneSkills:- Data Engineer Python - Must have hands-on in Coding Pyspark/Spark-Must have Data modelling Must have AWS- Must have SQL- Must have experience in writing queries. Must have experience in Data Lake/Lakehouse and open formats such as Iceberg, Hudi, Delta Lake" (remove Parquet) Must have...