Lead Databricks/Pyspark Developer

1 day ago

India Info Services Full time

Lead Databricks/Pyspark Developer

Location: Hyderabad or Chennai (Hybrid)

Fulltime with Info Services

Notice Period: 30 Days

Job Summary : Looking for an offshore Lead Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with team. This position is long term and will likely be renewed annually.

Essential Job Functions:

- Design and development of data ingestion pipelines (Databricks background preferred).

- Performance tune and optimize the databricks jobs

- Evaluated new features and refractors existing code

- Mentor junior developers and makes sure all patterns are documented

- Perform data migration and conversion activities.

- Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.

- Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).

- Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.

* Maintain and support the application.

* Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary

* Ensures to understand the requirements thoroughly and in detail and identify gaps in requirements

* Ensures that detailed unit testing is done, handles negative scenarios and document the same

* Work with QA and automation team.

* Works on best practices and documenting the process

* code merges and releases (Bitbucket)

* Works with architect and manager on designs and best practices

* Good data analysis skills

Other Responsibilities:

* Safeguard the company’s assets.

* Adhere to the company’s compliance program.

* Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.

* Maintain a focus on customer-service, efficiency, quality, and growth.

* Collaborating with additional team members

* Other duties as assigned.

Minimum Qualifications and Job Requirements:

* Must be a team player.

Must have following:

SCALA

SQL

Spark/Spark Streaming

Big Data Tool Set

Linux

Python/PySpark

Kafka

* Experience collaborating with dev team, project managers, and engineers.

* Excellent communication and teamwork skills

Please submit qualified resumes to / WhatsApp at: 9397933618

  • Azure Data Lead

    6 months ago

    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...

  • Databricks Developer

    1 month ago

    Anywhere in India/Multiple Locations Gen Full time

    About Genpact :Genpact is a global professional services and solutions firm that delivers outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose, the relentless pursuit of a world that works better for people,...

  • PySpark/Databricks Engineer

    1 month ago

    Anywhere in India/Multiple Locations/Hyderabad/Srinagar/Jaipur Aricent Full time

    Job Title: PySpark/Databricks EngineerWe are seeking a highly skilled PySpark/Databricks Engineer to join our team at Aricent. As a key member of our engineering team, you will be responsible for designing and building solutions for our Fortune 500 client programs.Key Responsibilities:Design, build, and unit test applications on the Spark framework using...

  • Azure Databricks Developer

    4 weeks ago

    Anywhere in India/Multiple Locations IT Source Global Full time

    Job Description:We are seeking a highly skilled Azure Databricks Engineer to join our team at IT Source Global.Key Responsibilities:Design, develop, and maintain scalable data processing solutions using Azure Databricks and Azure Data Factory.Build and optimize end-to-end data pipelines for batch and real-time data ingestion, transformation, and...

  • Databricks Developer

    2 months ago

    Anywhere in India/Multiple Locations, IN Gen Full time

    About the Company :Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better...

  • Databricks, SQL

    2 months ago

    india Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Greetings from TCS!!TCS is hiring for Databricks, SQL & Spyspark. Job Title : Databricks, SQL & Spyspark.Location : Pune, Mumbai & BangaloreExperience Range : 5 to 10 yearsQualifications:2-5 years of relevant IT experience with good exposure to Cloud technologies.Experience using Databricks and proficiency in Microsoft...

  • Azure Databricks Developer

    4 weeks ago

    Anywhere in India/Multiple Locations SAN Engineering Solutions Full time

    About the PositionAt SAN Engineering Solutions, we are seeking a skilled Azure Databricks Engineer to join our dynamic team. The ideal candidate will have extensive experience in Azure services, particularly Databricks, and will be responsible for designing, developing, and maintaining data pipelines and ETL processes.Key Responsibilities• Design and...

  • Azure Databricks

    2 months ago

    india Tata Consultancy Services Full time

    Greetings From TCS!Role-Azure Databricks DeveloperRequired Technical Skill Set-Azure databricks (Core), Azure services (Admin), Cosmos DB, Pyspark, Python, SQL, SSIS, ETLDesired Experience Range-4-8 YEARSLocation of Requirement -PUNEMust-HaveAzure databricks (Core)Azure services (Admin), Cosmos DBGood-to-HavePyspark, Python, SQL, SSIS, ETLStreaming and batch...

  • Databricks Developer Position

    4 weeks ago

    Anywhere in India/Multiple Locations Gen Full time

    About Genpact :Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose the relentless pursuit of a world that works better for...

  • Azure Databricks Engineer Position

    3 weeks ago

    Anywhere in India/Multiple Locations Hum Technologies Full time

    Data Engineering ExpertiseWe are seeking a skilled Azure Databricks Engineer with strong experience in Data Engineering on AWS/Azure and Databricks. The ideal candidate will have expertise in Databricks, AWS/Azure, and SQL, as well as experience in creating jobs using Pyspark and Python. This role will involve developing and tuning Spark Applications and...

  • Databricks, SQL

    6 days ago

    India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Greetings from TCS!! TCS is hiring for Databricks, SQL & Spyspark. Job Title : Databricks, SQL & Spyspark . Location : Pune, Mumbai & Bangalore Experience Range : 5 to 10 years Must-Have** Atleast 5+ years of Experience in Data Analytics as Azure Data engineer. Extensive experience on Design...

  • Databricks, SQL

    6 days ago

    India Tata Consultancy Services Full time

    Greetings from TCS!! TCS is hiring for Greetings from TCS!! TCS is hiring for Databricks, SQL & Spyspark. Job Title : Databricks, SQL & Spyspark . Location : Pune, Mumbai & Bangalore Experience Range : 5 to 10 years Must-Have** Atleast 5+ years of Experience in Data Analytics as Azure Data engineer. Extensive experience on Design...

  • Azure Databricks Engineer Position

    4 weeks ago

    Anywhere in India/Multiple Locations Hum Technologies Full time

    We are seeking an experienced Databricks expert with a strong background in data engineering on AWS/Azure to join our team at Hum Technologies. This role will involve working with Databricks, AWS/Azure, and SQL, creating jobs using Pyspark, and developing and tuning Spark Applications and Spark SQL queries.

  • Databricks Migration Engineer

    4 weeks ago

    India Delphic (South Asia) Full time

    Job Title: Databricks Migration EngineerJob Summary:We are seeking a skilled Databricks Migration Engineer to join our team at Delphic (South Asia). The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data...

  • Azure Databricks Engineer

    1 month ago

    Anywhere in India/Multiple Locations Hum Technologies Full time

    We are hiring for Azure Databricks Engineer Data Engineering experience on AWS/Azure and Databricks Strong Experience in Databricks, AWS/Azure, and SQL , creation of jobs using Pyspark. good exposure to Python.For one of the Fortune 500 Clients.Company Name : Hum Technologies Client : One of the Fortune 500 Companies Location : Remote/ HybridRole : Azure...

  • Data engineer

    2 weeks ago

    India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks) Location: Bangalore / Hybrid Job Type: Full-time Job Description: Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming...

  • PySpark/Databricks Engineer

    6 months ago

    Anywhere in India/Multiple Locations/Hyderabad/Srinagar/Jaipur, IN Aricent Full time

    Job : PySpark/Databricks EngineerOpen for Multiple Locations with WFO and WFHJob Description :We are looking for a PySpark solutions developer and data engineer that is able to design and build solutions for one of our Fortune 500 Client programs, which aims to build a data standardized and curation-based Hadoop clusterThis high visibility, fast-paced key...

  • Lead Data Engineer

    7 days ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    7 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Cloud Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations IT Source Global Full time

    Job Title: Cloud Data Engineer - Azure Databricks SpecialistJob Summary:We are seeking a highly skilled Cloud Data Engineer to join our team at IT Source Global. As a Cloud Data Engineer - Azure Databricks Specialist, you will be responsible for designing, developing, and maintaining scalable data processing solutions using Azure Databricks and Azure Data...