Databricks Engineer

5 days ago


Delhi, India iVedha Inc. Full time
Company DescriptioniVedha Inc. is a leading global cloud managed services provider and managed hybrid cloud services provider for enterprises. Based in Canada, iVedha serves clients in the USA, Mexico, and worldwide, offering innovative solutions for digital transformation needs across industries. As a trusted professional services partner, iVedha empowers businesses through disruptive technologies to Migrate, Modernize, Secure, Manage, and Monetize their data.As a Databricks Data Engineer, you will play a key role in designing, implementing, and maintaining data pipelines on the Databricks platform that support business and technology objectives. Your primary focus will be on building scalable and efficient data ingestion, transformation, and processing solutions to support our data-driven initiatives. You enjoy working both autonomously and as part of a team and have the confidence to influence and communicate with stakeholders at all levels, and to work in a fast-paced complex environment.About the role:You will be working on client projects with teams from across Data Platform and Applied Intelligence practice alongside industry, functional and technology Subject Matter Experts on challenging projects.You will be involved in the design and implementation of complex data solutions ranging from batch to streaming and event-driven architectures, across cloud, on-premise and hybrid client technology landscapes. We are looking for 3+ years of experience in data engineering in a customer or business facing capacity and experience in the following:Preferred
- Ability to understand and articulate requirements to technical and non-technical audiences
- Stakeholder management and communication skills, including prioritizing, problem solving and interpersonal relationship building
- Experiences with design, develop, and implement end-to-end data engineering solutions using Databricks for large-scale data processing and data integration projects.
- Build and optimize data ingestion processes from various sources, ensuring data quality, reliability, and scalability.
- Perform data transformation tasks, including data cleansing, aggregation, enrichment, and normalization, using Databricks and related technologies.
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues, data quality problems, and other technical challenges.
- Implement best practices for data governance, data security, and data privacy within the Databricks environment.
- Strong SQL, Python, PySpark knowledge
- Collaborate with DevOps and infrastructure teams to optimize the performance and scalability of Databricks clusters and resources.
- Provide guidance and mentorship to junior data engineers, fostering a culture of knowledge sharing and continuous learning within the team.Desirable
- Knowledge in DataOps and experience in delivering CI/CD and DevOps capabilities in a data environment
- Experience with advanced analytics and machine learning frameworks such as Apache Spark MLlib, TensorFlow, or PyTorch.
- Proficiency in data visualization tools such as Tableau, Power BI, or Looker
- Certification in Databricks Engineer Professional would be a plus.
  • Architect : Big Data

    3 months ago


    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...


  • Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Solutions Architect

    3 months ago


    Delhi Cantonment, Delhi, Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Databricks Engineer

    5 days ago


    Delhi, India iVedha Inc. Full time

    Company DescriptioniVedha Inc. is a leading global cloud managed services provider and managed hybrid cloud services provider for enterprises. Based in Canada, iVedha serves clients in the USA, Mexico, and worldwide, offering innovative solutions for digital transformation needs across industries. As a trusted professional services partner, iVedha empowers...

  • Sr Manager

    3 weeks ago


    New Delhi, India Databricks Full time

    FEQ225R60As a Leader (Strategic Accounts, Data & AI) will lead a team of Specialist Solutions Architects (Data & AI), who are Subject Matter Experts in Big Data / Data Engineering / AI & ML, focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, building and lead a technical...


  • New Delhi, India Databricks Full time

    FEQ424R284As a Leader in Solutions Architecture (Strategic Accounts, Data & AI) , you will lead a team of Solutions Architects (Data & AI) focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, you will build and lead a technical pre-sales team. Your experience partnering with the...

  • Sr Manager

    4 weeks ago


    New Delhi, India Databricks Full time

    FEQ225R60As a Leader (Strategic Accounts, Data & AI) will lead a team of Specialist Solutions Architects (Data & AI), who are Subject Matter Experts in Big Data / Data Engineering / AI & ML, focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, building and lead a technical...

  • Databricks Developer

    24 hours ago


    Delhi, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Sr. DataBricks DeveloperRequired Skillset: Azure Databricks & PysparkLocation: Hyderabad, Chennai, Noida,Pune,Banglore and IndoreExperience Range: 4- 10 yearsNote: Virtual Interview will be conducted on 12-Sep-24 (Thursday)Job DescriptionMust-Have**1. Expertise in Azure Databricks & Pyspark Database : PL-SQL / Oracle Sql- Strong...


  • New Delhi, India Databricks Full time

    FEQ424R284As a Leader in Solutions Architecture (Strategic Accounts, Data & AI) , you will lead a team of Solutions Architects (Data & AI) focusing on large enterprise & strategic customers in India. You will help lead our APJ Region (Asia Pacific and Japan) expansion, you will build and lead a technical pre-sales team. Your experience partnering with the...


  • Delhi, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Sr. DataBricks DeveloperRequired Skillset: Azure Databricks & PysparkLocation: Hyderabad, Chennai, Noida,Pune,Banglore and IndoreExperience Range: 4- 10 yearsNote: Virtual Interview will be conducted on 12-Sep-24 (Thursday)Job DescriptionMust-Have**1. Expertise in Azure Databricks & Pyspark Database : PL-SQL / Oracle Sql- Strong...

  • Cloud Data Engineer

    2 weeks ago


    Delhi, India Info Services Full time

    Job Summary:*Cloud Data Engineer (Azure & Databricks)*As a cloud engineer for Azure, you will be responsible for designing and implementing scalable, high-performance data engineering solutions using Azure Databricks and Azure Data Factory.Essential Job Functions:*Responsibilities:*- Design and implementation of complex cloud solutions using Microsoft Azure,...

  • Databricks Architect

    2 weeks ago


    Delhi, India iVedha Inc. Full time

    Company Description:iVedha Inc. is a leading global cloud managed services provider and managed hybrid cloud services provider for enterprises. Based in Canada, iVedha serves clients in the USA, Mexico, and worldwide, offering innovative solutions for digital transformation needs across industries. As a trusted professional services partner, iVedha empowers...


  • delhi, India JRD Systems Full time

    Azure Data EngineerDesign and implementation of complex cloud solutions using Microsoft Azure, focusing on integration with Databricks and Azure Data Factory.Develop and maintain scalable and efficient data pipelines and architectures.Ensure optimal architecture and performance of applications deployed on Azure.Provide expertise in cloud security, ensuring...


  • Delhi, India BatchService Full time

    Job SummaryWe are seeking an experienced Databricks Machine Learning Consultant for a project-based role to expedite the deployment and execution of machine learning models within our Databricks environment. This role focuses on the deployment and training of a machine learning model to create predictive metrics using our existing infrastructure. The...


  • Delhi, India Elgebra Full time

    4 to 5 years of experience in Snowflake with DatabricksExperience working with large, heterogeneous data sets in building and optimizing data pipelines and solutions on the Databricks platform to support our data-driven initiativesDevelop data set processes for data modeling and data mining purposesProficiency in Python programming with a strong...


  • delhi, India Sequantix Full time

    Responsibilities:Design and implement highly available and scalable Azure cloud data solutions that meet business requirements.Collaborate with cross-functional teams to design and implement solutions that meet business requirements.Participates in the testing process through test review and analysis.Developing and maintaining data lake and data warehouse...


  • Delhi, India Streamline Full time

    Data EngineerWho We AreStreamline is a trusted partner for achieving digital transformation. With deep expertise in Enterprise Mobility, Product Engineering, and IT Transformation, we equip organizations to navigate the ever-changing IT landscape. We work closely with our clients, fostering lasting partnerships and embracing open communication to deliver...

  • Databricks Architect

    3 months ago


    Delhi NCR/Noida/Greater Noida, India Talent Zone Consulting Pvt Ltd Full time

    Job Description :We are seeking a talented and experienced Senior Database Architect with a strong background in the Databricks platform to join our dynamic team. The ideal candidate will have a proven track record of designing and implementing BI, Analytics and DWH solutions, focusing on optimizing performance, scalability, and reliability.Responsibilities...

  • Senior Data Engineer

    2 weeks ago


    Delhi, India Quantiphi Full time

    Role : Senior Data EngineerYears of Experience : 3-12 yearsLocation : Mumbai/Bangalore (Hybrid)Must have skills:3+ years’ of hands-on experience in delivering data solutionsExperience with AWS S3,Step functions,Glue,Secrets ManagerExperience with Databricks implementationsExperience in implementing data integration projects using ETL (preferably Qlik...

  • Senior Data Engineer

    4 weeks ago


    Delhi, India USEReady Full time

    Designation: Lead Data EngineerLocation: Bangalore/Mohali/GurugramExperience: 10-14 yearsJob DescriptionMentor a team of developers in building and maintaining high-quality, scalable, and secure data pipelines and analytics applications on the Databricks platformWork closely with data engineers, business stakeholders to understand their needs and design and...