Databricks Engineer

3 days ago

Hyderabad, Telangana, India LTIMindtree Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Databricks & HDI Job Description :

  • With increasingly vast seas of digital information, smart organizations can today do things that were up to now impossible; spot unseen business trends, prevent diseases, make our roads safer and so on.

At Version 1 our Mission is to prove IT can make a real difference. We prove this every day and due to continued expansion, we're searching for like-minded individuals to help us 'take it to the next level'.

  • This is an exciting opportunity for an experienced developer of large scale data solutions.

You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer.

  • The ideal candidate will have a proven track record in implementing data ingestion and transformation pipelines for large scale organizations.

We are seeking someone with deep technical skills in a variety of technologies to play an important role in developing and delivering early proofs of concept and production implementation.

  • You will gain good experience in building solutions using a variety of open source tools a Microsoft Azure services and a proven track record in delivering high quality work to tight deadlines.
  • Your main responsibilities will be:
  • Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Databricks and/or HDInsights
  • Delivering and presenting proofs of concept to of key technology components to project stakeholders.
  • Developing scalable and re-usable frameworks for ingesting of geospatial data sets
  • Integrating the end to end data piple-line to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
  • Working with event based / streaming technologies to ingest and process data
  • Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
  • Evaluating the performance and applicability of multiple tools against customer requirements
  • Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
  • Qualifications
  • You will have:·
  • Strong knowledge of Data Management principles
  • Experience in building ETL / data warehouse transformation processes
  • Direct experience of building data pipelines using HDInsights and Apache Spark (preferably Databricks).
  • Experience using geospatial frameworks on Apache Spark and associated design and development patterns
  • Microsoft Azure

Big Data Architecture certification.

  • Hands on experience designing and delivering solutions using the Azure Data Analytics platform (Cortana Intelligence Platform) including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
  • Experience with Apache Kafka / Nifi for use with streaming data / event-based data
  • Experience with other

Open Source big data products Hadoop (incl. Hive, Pig, Impala)

  • Experience with

Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)

  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev/Ops environment with tools such as Microsoft Visual Studio Team Services, Chef, Puppet or Terraform

  • Databricks Engineer

    2 days ago

    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...

  • Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India Stanra Tech Solutions Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are looking for a skilled and experienced Databricks Engineer to join our team at our Hyderabad (Madhapur) office. The ideal candidate will have a strong background in data engineering, hands-on experience with Databricks, and a solid understanding of cloud platforms (AWS, Azure, or GCP). This is a great opportunity to work on cutting-edge data projects...

  • Databricks Architect

    2 days ago

    Hyderabad, Telangana, India Paltech Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Design and develop the migration strategies and processesCollaborate with stakeholders to understand business requirements and technical challenges.Analyze current data and scope for optimization during the migration process.Define the architecture and roadmap for cloud-based data and analytics transformation on Databricks.Design,...

  • Senior Data Engineer – Databricks

    4 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job Title: Senior Data Engineer – Databricks Location: Hyderabad / Ahmedabad Experience: 6+ Years About the Role We are looking for a Senior Data Engineer with a strong foundation in data warehousing, cloud-native data engineering, and deep hands-on experience with Databricks. Exposure to Data Modelling is a strong plus. In this role, you will lead the...

  • Senior Data Engineer – Databricks

    4 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Job Title: Senior Data Engineer – DatabricksLocation: Hyderabad / AhmedabadExperience: 6+ YearsAbout the RoleWe are looking for a Senior Data Engineer with a strong foundation in data warehousing, cloud-native data engineering, and deep hands-on experience with Databricks. Exposure to Data Modelling is a strong plus. In this role, you will lead the design...

  • Azure Databricks Engineer

    2 days ago

    Hyderabad, Telangana, India Tekskills Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Role: Azure Databricks EngineerJob Location: New Delhi / Hyderabad, TS / Gurgaon, HR / Chennai, TN / Bangalore, KA / Noida, UPWork Mode: (Hybrid/WFO)Skills Required: Azure DatabricksExperience: 6-8 Years(Rel 5+ Yrs)Job Description:Design and develop reusable software modules that meet customer requirements while upholding high standards of reliability,...

  • Databricks Data Engineer

    6 days ago

    Hyderabad, Telangana, India Rubis software solutions Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    Position OverviewWe are seeking an experienced Data Engineer with strong expertise in Databricks, Azure Data Services ecosystem (ADF, ADLS, Microsoft Fabric, Synapse, etc.), Python, PySpark, and databases. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and solutions to enable advanced analytics,...

  • Databricks Administrator

    4 weeks ago

    Hyderabad, Telangana, India EverestDX Inc Full time

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...

  • Databricks Administrator

    3 weeks ago

    Hyderabad, Telangana, India EverestDX Inc Full time

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...

  • Databricks Developer

    1 day ago

    Hyderabad, Telangana, India Zetamicron Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...