Python / PySpark Engineer with AI Experience

3 days ago

New Delhi, India iDWTeam Full time

We are looking for a talented Python/PySpark Engineer with a strong understanding of AI/ML concepts to join our data and analytics team. The ideal candidate will be experienced in building scalable data pipelines, working with big-data technologies, and supporting machine learning workflows in production environments.Key Responsibilities- Develop and optimize data pipelines using Python and PySpark. - Work with large-scale datasets in distributed computing environments. - Collaborate with data scientists to prepare, transform, and operationalize data for ML models. - Implement and maintain data quality, validation, and monitoring frameworks. - Support ML model deployment, performance tracking, and lifecycle management. - Apply AI/ML concepts such as feature engineering, model evaluation, and inference workflows. - Integrate data from cloud storage, APIs, databases, and streaming sources. - Follow best practices for code quality, version control, and CI/CD automation.-Required Skills & Experience- 3+ years of hands-on experience with Python for data engineering or data-related development. - Strong experience with PySpark and distributed data processing. - Understanding of AI/ML concepts (feature engineering, training pipelines, model monitoring, etc.). - Experience with cloud platforms (Azure / AWS / GCP). - Strong SQL skills for data manipulation and performance tuning. - Experience with Git and CI/CD pipelines. - Ability to work in a fast-paced, collaborative environment.-Preferred Qualifications- Experience with ML frameworks (TensorFlow, PyTorch, Scikit-learn). - Exposure to MLOps tools (MLflow, Kubeflow, SageMaker, Azure ML). - Experience with orchestration tools such as Airflow, ADF, or Databricks Workflows. - Familiarity with data-lake and lakehouse architectures. - Knowledge of data visualization tools (Power BI, Tableau).-What We Offer- Competitive salary and benefits package. - Opportunity to work with modern data and AI technologies. - Learning and certification support. - Collaborative and innovative work environment.-

  • Python Pyspark SDET

    4 weeks ago

    New Delhi, India InfoBeans Full time

    Job Title: SDET – PySpark/Python Data Engineering (Azure Cloud)Location: Indore | Pune | Bangalore | ChennaiExperience Required: 5+ yearsRole Overview:Seeking a skilled Software Development Engineer in Test (SDET) with expertise in PySpark and Python for data engineering and data pipeline validation on Azure Cloud. You will play a critical role in building...

  • Data Engineer

    4 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    Greetings from Tata Consulting Services!!!Role: Data Engineer with Mandatory Pyspark, Python Knowledge Desired Experience Range: 5 to 10 yrs Location: Pune, Hyderabad, Chennai, Bangalore, Kochi, Bhubaneshwar Notice period: 0 To 30 Days Interview Mode: Virtual Mode Interview Date: 13th Nov 2025 Time Of Interview: 10AM TO 2PM Required Technical Skill Set:...

  • Data Engineer

    1 week ago

    New Delhi, India Tata Consultancy Services Full time

    TCS is Hiring for Data Engineer -Python with AI/ML,pyspark,AWSExperience: 4 to 10 years Location: Bhubaneswar Experience with ETL/Python/SQL, and data visualization/exploration tools. Experience in building complex SQL queries. Familiarity with the Azure Databricks, Azure Data Factory. Experience in building or maintaining ETL pipelines. Experience in...

  • Python +pyspark

    2 weeks ago

    Delhi, India Nityo Infotech Full time

    2 hours ago **Job Code**: JD-19623 **JOB DESCRIPTION**: Mandatory Skills - Python, Pyspark, DataBricks, SQL Primary Skills: - Hands-on Python, PySpark, Databricks, SQL, AWS (S3, Lambda, EC2, RDS), and CI-CD tools. Job description: - 6 or more years of experience developing, testing, and implementing major Information Technology programs or projects that...

  • Pyspark Data Engineer

    4 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    Role: Data Engineer with Mandatory Pyspark KnowledgeRequired Technical Skill Set: Python , Pyspark, BigQueryDesired Experience Range: 5+ yrsDesired Experience: 0-60 DaysLocation: Bangalore, Pune, Chennai, GurugramDesired Competencies (Technical/Behavioral Competency)- Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based...

  • Pyspark Data Engineer

    3 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    Role: Data Engineer with Mandatory Pyspark Knowledge Required Technical Skill Set: Python , Pyspark, BigQuery Desired Experience Range: 5+ yrs Desired Experience: 0-60 Days Location: Bangalore, Pune, Chennai, GurugramDesired Competencies (Technical/Behavioral Competency)Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based...

  • Python/Pyspark, Bigquery with GCP, Apache Iceberg

    7 days ago

    New Delhi, India Tata Consultancy Services Full time

    TCS Hiring !!Virtual Drive ***12-Nov-25 Python/Pyspark, Bigquery with GCP, Apache IcebergTCS - Hyderabad12 PM to 1 PMImmediate Joiners5 to 7 yearsRole** Python/Pyspark, Bigquery with GCP, Apache IcebergExp -5 to 7 yearsPlease read Job description before ApplyingNOTE: If the skills/profile matches and interested, please reply to this email by attaching your...

  • Data Engineer

    2 weeks ago

    Delhi, India Tata Consultancy Services Full time

    TCS is Hiring for Data Engineer -Python with AI/ML,pyspark,AWS Experience : 4 to 10 years Location : Bhubaneswar Experience with ETL/Python/SQL, and data visualization/exploration tools. Experience in building complex SQL queries. Familiarity with the Azure Databricks, Azure Data Factory. Experience in building or maintaining ETL pipelines. Experience in...

  • Pyspark Data Engineer

    3 days ago

    New Delhi, India Tata Consultancy Services Full time

    Role: Pyspark Data Engineer Experience Range: 5+ yrs hands on experience Location: Bangalore/Pune/Chennai/Gurugram Mode of Interview: Virtual ModeRoles & Responsibilities: Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques Good python...

  • Pyspark Data Engineer

    2 days ago

    New Delhi, India Tata Consultancy Services Full time

    Role: Pyspark Data Engineer Experience Range: 5+ yrs hands on experience Location: Bangalore/Pune/Chennai/Gurugram Mode of Interview: Virtual ModeRoles & Responsibilities: Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques Good python...