Lead Databricks/PySpark Developer

2 weeks ago


Delhi, Delhi, India C2E Consultancy Full time

Job Summary :

Looking for an offshore Lead Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with team.

This position is long term and will likely be renewed annually.

Job Title : Developer

Essential Job Functions :

- Design and development of data ingestion pipelines (Databricks background preferred).

- Performance tune and optimize the databricks jobs

- Evaluated new features and refractors existing code

- Mentor junior developers and makes sure all patterns are documented

- Perform data migration and conversion activities.

- Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.

- Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.libraries, modules, execution environments).

- Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.

- Maintain and support the application.

- Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary

- Ensures to understand the requirements thoroughly and in detail and identify gaps in requirements

- Ensures that detailed unit testing is done, handles negative scenarios and document the same

- Work with QA and automation team.

- Works on best practices and documenting the process

- code merges and releases (Bitbucket)

- Works with architect and manager on designs and best practices

- Good data analysis skills

Other Responsibilities :

- Safeguard the company's assets.

- Adhere to the company's compliance program.

- Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.

- Maintain a focus on customer-service, efficiency, quality, and growth.

- Collaborating with additional team members

- Other duties as assigned.

Minimum Qualifications and Job Requirements :

- Must be a team player.

Must have following :

- SCALA

- SQL

- Spark/Spark Streaming

- Big Data Tool Set

- Linux

- Python/PySpark

- Kafka

- Experience collaborating with dev team, project managers, and engineers.

- Excellent communication and teamwork skills

Exp : 7 to 12 years

(ref:hirist.tech)

  • Delhi, Delhi, India Tata Consultancy Services Full time

    Azure Databricks Developer (Python + Pyspark)Azure Databricks Developer (Python + Pyspark)Experience: 4 years to 12 yearsLocation: Delhi, Kolkata, Chennai, Hyderabad, Bangalore, PuneInterview Mode: OnlineInterview Date: 8th March 2025Interview Time: 10: 00 AM to 5: 00 PMMust Have:4 or more years of experience working on Azure Databricks using Scala, PySpark...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Job Overview:Azure Databricks Developer (Python + Pyspark)Job Description:This role involves working as a full stack engineer in a scrum team. Assist in defining product technical architecture. Maintain and document deliverables in Rally as needed. Participate in peer reviews for designs, code, and other work products and scrum ceremonies. Perform software...

  • Databricks Engineer

    1 week ago


    Delhi, Delhi, India BOHIYAANAM TECHNOLOGY LLP Full time

    Role : Databricks Engineer Experience Preferred : 8+ YearsLocation : RemoteJob Description : - Design, build, and optimize scalable ETL/ELT pipelines on Databricks using PySpark, Scala, or SQL.- Collaborate with data architects to implement data lakehouses and other modern data infrastructure on Databricks.- Ensure optimal performance of Databricks jobs by...


  • Delhi, Delhi, India LTIMindtree Full time

    We are hiring for AWS+DatabricksExp:-4-12 YearsLocation:-All Ltimindtree LocationsSkill Set:-AWS + Databricks:- Good Pyspark + SQL skills- Databricks- Python

  • Databricks Engineer

    1 week ago


    Delhi, Delhi, India ASB RESOURCES TECHNOLOGY SOLUTIONS PRIVATE LIMITED Full time

    Job Title : Databricks Consultant / Data EngineerJob Summary : We are seeking a skilled Databricks Consultant to join our team. The ideal candidate will possess extensive experience in creating, managing and optimizing data engineering pipelines using Databricks and associated technologies.Responsibilities :1. Worked on Lakehouse ETL Projects: - Execute ETL...

  • Data Engineer

    2 days ago


    Delhi, Delhi, India LTIMindtree Full time

    At LTIMindtree, we are hiring for a challenging role that requires expertise in AWS and Databricks. As a Data Engineer - Databricks Expert, you will be responsible for designing, developing, and maintaining large-scale data pipelines using PySpark and SQL.The ideal candidate should have 4-12 years of experience working with AWS and Databricks. You should be...


  • Delhi, Delhi, India Appice Full time

    Company Description Appice, a leading provider of mobile marketing automation platforms, is redefining the way banks and fintech companies engage with their customers. As a flagship product of Semusi, with over 12 years of experience in mobile and enterprise software, Appice offers advanced solutions for mobile acquisition, engagement, retention, and...

  • Databricks Engineer

    1 week ago


    Delhi, Delhi, India Think bridge Software Pvt. Ltd. Full time

    We are seeking a highly skilled Databricks Consultant to work remotely with one of our esteemed clients in New York City. In this role, you will leverage your expertise in Databricks and data engineering to build scalable solutions, optimize data pipelines, and enable advanced analytics capabilities for the client. About thinkbridge. thinkbridge is how...

  • Databricks Engineer

    2 weeks ago


    Delhi, Delhi, India Think bridge Software Pvt. Ltd. Full time

    We are seeking a highly skilled Databricks Consultant to work remotely with one of our esteemed clients in New York City. In this role, you will leverage your expertise in Databricks and data engineering to build scalable solutions, optimize data pipelines, and enable advanced analytics capabilities for the client. About thinkbridge. thinkbridge is how...


  • Delhi, Delhi, India Appice Full time

    Company DescriptionAppice, a leading provider of mobile marketing automation platforms, is redefining the way banks and fintech companies engage with their customers. As a flagship product of Semusi, with over 12 years of experience in mobile and enterprise software, Appice offers advanced solutions for mobile acquisition, engagement, retention, and...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Required Skills and QualificationsTo be successful in this role, you should possess the following skills and qualifications:Bachelor's degree in Computer Science, Information Technology, or related fieldMinimum 5 years of experience in big data engineering, preferably with Azure DatabricksHands-on experience with Python, PySpark, and SQL programming...


  • Delhi, Delhi, India Hexaware Technologies Full time

    Hi All,Greetings of the dayF2F(Walkin)Drive_15 Mar 25(Saturday)_ in Hyderabad _Azure Databricks with Hexaware TechnologiesRequest you to go through the Job Description thoroughly and if interested, please fill the below mentioned details to process your candidature.1. Total Experience-2. Relevant Experience(Azure Databricks)-Pyspark-Python-SQL-DWH-3. Current...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Note-This will be a Walk-In drive @ Delhi Location, on 1 -02-2025Required InformationDetailsRole**Databricks DeveloperRequired Technical Skill Set**Azure DatabricksDesired Experience Range**6 to 8 yrsLocation of RequirementDelhiDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5)Azure Databricks – E2Pyspark...


  • Delhi, Delhi, India Nucleocoders Technologies Full time

    Nucleocoders Technologies Job DescriptionAt Nucleocoders Technologies, we are committed to delivering high-quality data solutions that meet the evolving needs of our clients. We are seeking an experienced Sr. Databricks Developer to join our team. In this role, you will design and develop data processing pipelines and analytics solutions using Databricks,...


  • Delhi, Delhi, India Tata Consultancy Services Full time

    Note-This will be a Walk-In drive @ Delhi Location, on 1 -02-2025Required InformationDetailsRole**Databricks DeveloperRequired Technical Skill Set**Azure DatabricksDesired Experience Range**6 to 8 yrsLocation of RequirementDelhiDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not be more than 3-5)1. Azure Databricks – E22....


  • Delhi, Delhi, India Hexaware Technologies Full time

    Azure Databricks Developer RoleWe are seeking a highly skilled Technical Lead for our Cloud Data Engineering team. The ideal candidate will have 6-12 years of experience in IT, preferably in cloud computing, with a minimum of 4 years of experience in Azure Databricks on development projects.Key Responsibilities:Lead the design and implementation of data...


  • Delhi, Delhi, India SYSTEM SOFT TECHNOLOGIES INDIA PRIVATE LIMITED Full time

    Responsibilities :- Design, develop, and deploy data solutions on Azure Databricks, leveraging its capabilities for data engineering, machine learning, and business intelligence.- Architect and implement data pipelines using Spark, Delta Lake, and other relevant technologies within the Databricks ecosystem.- Optimize Databricks clusters and jobs for...

  • ADF - Data Engineer

    2 weeks ago


    Delhi, Delhi, India Tata Consultancy Services Full time

    Greetings from TCS TCS is hiring for Digital : Databricks Job Title : Digital : Databricks Location : Delhi, Bangalore Experience Range : 4 to 10 years Roles and Responsibilities: 5+ years experienced senior data engineer with sound ADF, Databricks and Pyspark knowledge and able to interact independently with customer technical team/leads ...

  • Data Engineer

    11 hours ago


    Delhi, Delhi, India RMV WORKFORCE LLP Full time

    Role : Data Engineer (Databricks). Experience : 5- 8 Years. Location : Gurugram, Bengaluru, Hyderabad. Notice Period : Immediate. Must Have Skills : Pyspark, Azure, ADF, Databricks, ETL, SQL, Excellent communications skills. Job Description :- Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks.- Design and build ETL pipelines...


  • Delhi, Delhi, India RapidBrains Full time

    Job Description:We are looking for a seasoned Senior Data Solutions Developer to help us build and maintain complex data solutions. The ideal candidate should have hands-on experience in designing and implementing data lake solutions using AWS (S3, EMR, Databricks), Hive, and PySpark.