Current jobs related to PySpark/Databricks Engineer - Jaipur - Aricent

  • Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQL

    2 weeks ago

    Jaipur, India Tata Consultancy Services Full time

    Role : Azure Data Engineer(ADF, ADB) with Pyspark and PL/SQLJOB LOCATION : BhubaneswarEXPERIENCE REQUIREMENT : 6+Technical Skill Set :Azure Data Engineer, ADF, Azure Databricks Spark (PySpark or Scala), Python, PL/SQLMust have:Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud connectivity between...

  • Data Engineer

    3 weeks ago

    Jaipur, India Concentrix Full time

    Job Description: Experience: 4 Years - 10 Years Job Location: Hyderabad/ Bengaluru/ Chennai/ Kolkata/ Mumbai/ Pune Work Mode: Remote (May be Hybrid later) Notice Period: Immediate to 1 week We are seeking a skilled Databricks Data Engineer with expertise in Scala to design, implement, and maintain scalable data solutions on the Databricks platform. The ideal...

  • Databricks Admin

    20 hours ago

    Mansarovar, Jaipur, Rajasthan, India Den Agencies Full time

    **Expertise in Databricks Administration** - Unity Catalog, Cluster Management, System Tables, Troubleshooting. Cloud & DevOps - AWS (S3, Lambda, EMR), Docker, Kubernetes. Big Data & Coding Skills - Strong fundamentals in Data Warehousing (DW/DH), Spark/Python. Certifications - Certified Databricks Engineer preferred. Problem-Solving - Ability to...

  • Azure Data Engineer

    1 week ago

    Jaipur, India HTC Global Services Full time

    HTC Global Services - a leading CMM level 5 global provider of innovative IT and Business Process Services and Solutions since 1990 with headquarters in Troy, Michigan, USA.We are hiring Azure Data Engineer for our premium Airlines project.Mandatory Skills: Azure Data Engineering Stack(Data Factory, Data bricks, Synapse, Data Lake) & Python/Pyspark.Job...

  • Durapid Technology

    3 days ago

    Gurgaon/Gurugram/Jaipur, India Durapid Technologies Private Limited Full time

    Job Description : Key Responsibilities :- Build and maintain ETL/ELT pipelines using Azure Data Bricks and PySpark.- Transform, clean, and structure data for analytics and reporting.- Manage Azure Data Lake for data storage and optimization.- Leverage Azure Event Hub for real-time data ingestion.- Collaborate with stakeholders to understand data...

  • Sr. Python Developer

    2 days ago

    Jaipur, India OnPoint Insights Full time

    Job Title: Backend Developer(Python Expertise)Experience Level: Mid to Senior (4+ years)Location: RemoteJob Description:Responsibilities:Design, develop, and maintain backend services and APIs using Python and frameworks such as Django, Flask, and FastAPI.Implement and manage databases, both SQL (e.g., PostgreSQL, MySQL) and NoSQL (e.g., MongoDB,...

  • Azure Data Engineer

    2 weeks ago

    Jaipur, India HTC Global Services Full time

    Azure Data EngineerExperience: 6+ yearsLocation: Chennai/Bangalore/HyderabadNotice Period: Immediate to 15 daysJob Description:Azure Data Engineer with 6+ years of experience in Azure Data Engineering Stack, Data Lakes, Synapse, Python/Pyspark.Interested candidates please do share your updated CV to nivetha.harikrishnan@htcinc.com along with below mentioned...

  • Senior Data Engineer

    6 days ago

    Jaipur, India Kadel Labs Pvt. Ltd Full time

    Job Description :Roles & Responsibilities :- Design, develop, and optimize data pipelines for efficient data integration, transformation, and storage.- Implement and migrate ETL workflows across various platforms such as SQL Server, ADF, Synapse, Databricks, and SSIS.- Collaborate with stakeholders to architect scalable and high-performance data solutions,...

  • Senior Data Engineer

    1 day ago

    Jaipur, India Kadel Labs Pvt. Ltd Full time

    Job Description :Roles & Responsibilities :- Design, develop, and optimize data pipelines for efficient data integration, transformation, and storage.- Implement and migrate ETL workflows across various platforms such as SQL Server, ADF, Synapse, Databricks, and SSIS.- Collaborate with stakeholders to architect scalable and high-performance data solutions,...

  • Thrillophilia - Senior Machine Learning & Artificial Intelligence Engineer - Python/PySpark

    3 weeks ago

    Jaipur, India Thrillophilia.com Full time

    Position Overview :We are seeking an experienced Senior Machine Learning and Artificial Intelligence (ML/AI) Engineer to join our team and lead the development cutting-edge AI solutions, including large language models, generative AI, chatbots, and intelligent recommendation systems.Key Responsibilities : - Design, develop, and deploy scalable ML/AI...

  • Data Engineer

    1 day ago

    Jaipur, India Kadel Labs Full time

    Role : SSE-Data EngineeringKadel Labs is a first-of-its-kind Venture Studio in India. It is a global software technology system incubator with synergistic blend of IT Services and SaaS products under its portfolio. Since 2017, KL has grown organically (180+ employees and expanding) and served 200+ Customers. At the core, KL is a people's company. We...

  • Senior Data Engineer

    1 day ago

    jaipur, India r3 Consultant Full time

    Job Description: Senior Data Engineer Role Overview: We are seeking an experienced Senior Data Engineer to design, develop, and optimize our data pipeline architecture. This role involves creating scalable and efficient systems to process and manage large datasets across the organization. As a Senior Data Engineer...

  • Data Engineer

    4 weeks ago

    Jaipur, India Nlineaxis Full time

    Job Description : Data EngineerLocation : JaipurExperience : 5+ YearsSummary :We are looking for a dedicated Data Engineer with over 5 years of experience in designing, developing, and maintaining ETL processes for data integration. The ideal candidate will bring expertise in tools like Data Bricks, proficiency in SQL, and experience in cloud environments to...

  • Data Engineer

    1 day ago

    Jaipur, India Nlineaxis Full time

    Job Description : Data EngineerLocation : JaipurExperience : 5+ YearsSummary :We are looking for a dedicated Data Engineer with over 5 years of experience in designing, developing, and maintaining ETL processes for data integration. The ideal candidate will bring expertise in tools like Data Bricks, proficiency in SQL, and experience in cloud environments to...

  • Lead Data Architect and Engineer

    3 days ago

    Jaipur, Rajasthan, India r3 Consultant Full time

    Job Descriptionr3 Consultant is seeking an experienced Senior Data Engineer to lead the design, development, and optimization of our data pipeline architecture.This role involves creating scalable and efficient systems to process and manage large datasets across the organization. As a Senior Data Engineer, you will collaborate closely with software...

  • Senior Machine Learning Engineer

    3 weeks ago

    Jaipur, India Thrillophilia.com Full time

    Position Overview: We are seeking an experienced Senior Machine Learning and Artificial Intelligence (ML/AI) Engineer to join our team and lead the development cutting-edge AI solutions, including large language models, generative AI, chatbots, and intelligent recommendation systems. Key Responsibilities: - Design, develop, and deploy scalable ML/AI...

  • Senior machine learning engineer

    6 hours ago

    Jaipur, India Thrillophilia.com Full time

    Position Overview: We are seeking an experienced Senior Machine Learning and Artificial Intelligence (ML/AI) Engineer to join our team and lead the development cutting-edge AI solutions, including large language models, generative AI, chatbots, and intelligent recommendation systems. Key Responsibilities: Design, develop, and deploy scalable ML/AI solutions...

  • Senior machine learning engineer

    7 days ago

    Jaipur, India Thrillophilia.com Full time

    Position Overview: We are seeking an experienced Senior Machine Learning and Artificial Intelligence (ML/AI) Engineer to join our team and lead the development cutting-edge AI solutions, including large language models, generative AI, chatbots, and intelligent recommendation systems. Key Responsibilities: Design, develop, and deploy scalable ML/AI...

  • Data Engineer

    2 weeks ago

    jaipur, India Polestar Solutions & Services Full time

    About Polestar Solutions: Polestar, is a leading AI & analytics solutions company that serves Fortune 1000 companies, startups and the government across various industries, including CPG & retail, manufacturing and pharmaceuticals, among others. Headquartered in Texas, we have branches across Noida, Kolkata, Mumbai, Bangalore, and the UK. Our comprehensive...

  • Machine Learning Engineer

    3 days ago

    Jaipur, Rajasthan, India Durapid Technologies Private Limited Full time

    Company OverviewDurapid Technologies Private Limited is a leader in the field of data-driven solutions, providing innovative and effective ways to drive business growth and improvement.Job DescriptionKey ResponsibilitiesDevelop and implement data-driven strategies to drive business growth and improvement.Work with large datasets to prepare data for analysis...

PySpark/Databricks Engineer

1 month ago

Jaipur, India Aricent Full time

Job : PySpark/Databricks Engineer

Open for Multiple Locations with WFO and WFH

Job Description :

We are looking for a PySpark solutions developer and data engineer that is able to design and build solutions for one of our Fortune 500 Client programs, which aims to build a data standardized and curation-based Hadoop cluster

This high visibility, fast-paced key initiative will integrate data across internal and external sources, provide analytical insights, and integrate with the customer s critical systems

Key Responsibilities :

- Ability to design, build and unit test applications on Spark framework on Python.

- Build PySpark based applications for both batch and streaming requirements, which will require in-depth knowledge on majority of Hadoop and NoSQL databases as well.

- Develop and execute data pipeline testing processes and validate business rules and policies.

- Optimize performance of the built Spark applications in Hadoop using configurations around Spark Context, Spark-SQL, Data Frame, and Pair RDDs.

- Optimize performance for data access requirements by choosing the appropriate native Hadoop file formats (Avro, Parquet, ORC etc) and compression codec respectively.

- Ability to design build real-time applications using Apache Kafka Spark Streaming

- Build integrated solutions leveraging Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codec.

- Build data tokenization libraries and integrate with Hive Spark for column-level obfuscation

- Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.

- Create and maintain integration and regression testing framework on Jenkins integrated with BitBucket and/or GIT repositories

- Participate in the agile development process, and document and communicate issues and bugs relative to data standards in scrum meetings

- Work collaboratively with onsite and offshore team.

- Develop review technical documentation for artifacts delivered.

- Ability to solve complex data-driven scenarios and triage towards defects and production issues

- Ability to learn-unlearn-relearn concepts with an open and analytical mindset

- Participate in code release and production deployment.

- Challenge and inspire team members to achieve business results in a fast paced and quickly changing environment

- BE/B.Tech/ B.Sc. in Computer Science/Statistics, Econometrics from an accredited college or university.

- Minimum 3 years of extensive experience in design, build and deployment of PySpark-based applications.

- Expertise in handling complex large-scale Big Data environments preferably (20Tb+).

- Minimum 3 years of experience in the following: HIVE, YARN, HDFS preferably on Hortonworks Data Platform.

- Good implementation experience of OOPS concepts.

- Hands-on experience writing complex SQL queries, exporting, and importing large amounts of data using utilities.

- Ability to build abstracted, modularized reusable code components.

- Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responses

(ref:hirist.tech)