Databricks Developer

1 month ago


MumbaiKolkataHyderabad, IN Selsoftinc Full time

Job Description :


- Design, develop, and maintain data pipelines and workflows using Databricks.

- Create and manage ETL processes to ingest, process, and store large volumes of data.

- Develop and optimize Spark jobs and notebooks for efficient data processing.

Data Engineering :

- Work with large datasets and perform data transformations, aggregations, and analysis.

- Implement and manage data storage solutions in Databricks and Azure/AWS/GCP.

- Design and implement data models and schema changes as needed.

Collaboration :

- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.

- Provide technical support and guidance to team members and stakeholders on data-related issues.

Optimization and Performance :

- Monitor and optimize the performance of data pipelines and Spark jobs.

- Implement best practices for data governance, security, and quality.

Documentation and Reporting :

- Maintain clear documentation of data processes, architecture, and workflows.

- Create and present reports and dashboards to communicate findings and insights.

Qualifications :

- Education: Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field. Advanced degrees or certifications are a plus.

Experience :

- Proven experience as a Databricks Developer or similar role with strong expertise in Databricks and Spark.

- Hands-on experience with cloud platforms such as Azure, AWS, or GCP.

- Solid understanding of data modeling, ETL processes, and data warehousing concepts.

Technical Skills :

- Proficiency in Spark, Databricks, and related technologies.

- Strong programming skills in Python, Scala, or SQL.

- Experience with data integration tools and frameworks.

- Knowledge of big data technologies and data storage solutions.

Soft Skills :

- Excellent problem-solving and analytical skills.

- Strong communication and teamwork abilities.

- Ability to manage multiple tasks and work in a fast-paced environment.

Preferred Skills :

- Experience with machine learning and data science workflows.

- Familiarity with DevOps practices and tools related to data engineering.

- Knowledge of data privacy regulations and best practices

(ref:hirist.tech)

  • Kolkata/Mumbai/Hyderabad, IN Selsoftinc Full time

    Role : Data Bricks DeveloperExperience : 5+Years Location : Kolkata , Mumbai , HyderabadLocation : Job Summary : We are seeking a proficient Databricks Developer to design, build, and maintain scalable data pipelines. The ideal candidate will work closely with data scientists and business stakeholders to deliver high-quality data solutions.Key...


  • Hyderabad/Kolkata/Mumbai, IN Selsoft Full time

    Role : Data Bricks DeveloperLocation : Hyderabad, Mumbai, kolkataExperience : 5+yearsJob Summary :We are seeking a proficient Databricks Developer to design, build, and maintain scalable data pipelines. The ideal candidate will work closely with data scientists and business stakeholders to deliver high-quality data solutions.Key Responsibilities :- Develop...

  • Data Engineer

    6 months ago


    Pune/Hyderabad, IN EDGESOFT Full time

    Job Description :The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining our data infrastructure, ensuring seamless and efficient data processing.Responsibilities :- Design,...


  • Bangalore/Chennai/Hyderabad, IN Hirist.tech Full time

    Responsibilities :1. Role : Senior Databricks Engineer 2. Skills and Experience :- Extensive expertise in Databricks and Azure Data Factory (ADF).- Good understanding of Azure Synapse Analytics, ADLS, Azure SQL Server, Azure Logic Apps, APIs, Unity Catalog, Delta Lake, T-SQL, and Python.- Knowledge of Power BI connectors.3. Responsibilities :- Design,...


  • Bangalore/Pune/Chennai/Hyderabad, IN Foundit Full time

    Job Description :Tech Skills Required :- Minimum 5 years of experience with Azure development and data solutions.- High proficiency with Azure data technologies (Azure Data Factory, Databricks, Azure Synapse Analytics).- Strong proficiency in SQL and writing complex data queries.- Deep experience in all stages of Data Analysis, including data source...

  • Data Engineer

    1 month ago


    Bangalore/Hyderabad/Chennai, IN Rigel Networks Pvt Ltd Full time

    Key Responsibilities :- Design, develop, and maintain data pipelines using Python and Snowflake.- Implement data ingestion, transformation, and processing solutions leveraging Azure Databricks or Azure Data Factory.- Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.- Optimize and tune Snowflake...


  • Navi Mumbai/Pune/Bangalore, IN Techno Wise Full time

    Job Summary : We are seeking a highly skilled and motivated individual to join our team as a Senior Azure Data Engineer. The ideal candidate will have a strong background in Azure data technologies, a proven track record of ability to design and implement scalable and efficient data solutions.Responsibilities :- Design, develop, and deploy data pipelines and...

  • Azure Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations/Mumbai/Bangalore/Hyderabad/Kolkata/Chennai/Pune/Bhubaneshwar/Na, IN Talpro Full time

    Job Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....

  • Data Platform Lead

    1 month ago


    Hyderabad/Mumbai, IN Aptusdatalabs Technologies Pvt. Ltd Full time

    Company Description : Aptus Data Labs is an innovative Data & AI Company offering analytical solutions and consulting services to help businesses make data-driven decisions. We leverage primary data, data management technologies, Data Science, and Decision Science to provide insights and identify risks and opportunities for our clients across various...

  • Nuviso Networks

    1 month ago


    Hyderabad/Chennai/Bangalore, IN Nuviso Networks Full time

    1. Data Engineering & Development :- Design, develop, and maintain scalable data pipelines using Azure Databricks.- Implement ETL processes to ingest and transform data from various sources.2. Data Management :- Develop and maintain Delta Lake tables for efficient data storage and retrieval.- Ensure data quality and integrity through rigorous testing and...

  • Scala/Spark Developer

    1 month ago


    Mumbai/Hyderabad/Chennai/Pune/Bangalore, IN Monster.com Full time

    Job Description :Skill : Scala and SparkMainly Scala + Spark experience needed.- 5+ years of experience- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks : Spark, HBase, Hive and other Hadoop ecosystem technologies. - Development using Scala.-...


  • Anywhere in India/Multiple Locations/Hyderabad/Srinagar/Jaipur, IN Aricent Full time

    Job : PySpark/Databricks EngineerOpen for Multiple Locations with WFO and WFHJob Description :We are looking for a PySpark solutions developer and data engineer that is able to design and build solutions for one of our Fortune 500 Client programs, which aims to build a data standardized and curation-based Hadoop clusterThis high visibility, fast-paced key...

  • Scala/Spark Developer

    1 month ago


    Mumbai/Pune/Bangalore, IN Xoriant Solutions Full time

    We are eagerly seeking candidates with 5 to 9 years' experience for a Spark & Scala Developer to join our dynamic team. The ideal candidate will play a pivotal role for our business in delivering data and insights to our clients. We're driving the company's digital transformation and expanding business capabilities using industry best practices...

  • Data Engineer

    1 month ago


    Hyderabad/Bhubaneshwar, IN TALENTOV Full time

    Job Title : Senior Data EngineerLocation : Hyderabad/BhubhaneshwarJob Summary :We are seeking a skilled and experienced Senior Data Engineer to join our dynamic data team. The ideal candidate will have a strong background in data engineering, data warehousing, and a proven track record of implementing scalable data solutions. You will work closely with data...

  • Big Data Engineer

    1 month ago


    Bangalore/Pune/Mumbai/Chennai, IN a client of change leaders Full time

    Job Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...


  • Mumbai/Pune/Bangalore, IN Techno Wise Full time

    Job Description :We are seeking a talented and accomplished Machine Learning Engineer with expertise in Azure and Databricks. The ideal candidate will have a strong foundation in machine learning, deep learning, and artificial intelligence, with a proven track record of developing and deploying models in real-world applications. This role requires hands-on...

  • Big Data Engineer

    1 month ago


    Hyderabad/Pune/Delhi NCR, IN Ace Recruit Full time

    Job Description :As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might :- Design and build scalable & metadata-driven data ingestion...

  • PySpark Developer

    1 month ago


    Pune/Bangalore/Chennai/Hyderabad/Mysore, IN Vtricks Technologies Full time

    Job Title : PySpark Developer Location : Pune, Bangalore, Chennai, Hyderabad, MysoreMode of Work : Onsite/HybridNotice Period : Immediate to 10 daysJob Description :We are looking for an experienced PySpark Developer with strong hands-on experience in working with Data Frames and the PySpark development process using Azure services. The ideal candidate...


  • Mumbai/Bangalore/Pune/Chandigarh/Gurgaon/Gurugram, IN Techno Wise Full time

    Key Responsibilities :1. Lead Machine Learning Projects :Take full ownership of machine learning projects from start to finish, including problem definition, data collection, model development, and deployment.2. Algorithm Development : Develop and optimize machine learning algorithms using techniques such as deep learning, natural language processing,...

  • Data Engineer

    1 month ago


    Mumbai/Bangalore/Pune/Chennai/Hyderabad, IN Changeleaders Full time

    Company Overview :Tech Mahindra is a leading provider of digital transformation, consulting, and business re-engineering services and solutions. We leverage next-generation technologies to help our clients achieve their business objectives.Job Summary :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will be...