Data Brick

1 month ago

india Delphic (South Asia) Full time

Job Summary:

We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects. The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data integration tools. You will play a key role in designing, executing, and optimizing data migration pipelines to ensure a smooth and efficient transition to the Databricks platform.

Key Responsibilities:

  • Data Migration:
  • Lead and execute data migration projects to Databricks from legacy systems (on-premises/cloud-based).
  • Design, build, and maintain efficient data pipelines using Apache Spark on Databricks.
  • Optimize the performance of ETL jobs, ensuring high availability and scalability.
  • Data Architecture & Integration:
  • Collaborate with data architects and stakeholders to design effective data migration strategies.
  • Work closely with teams to understand business requirements and data sources.
  • Develop and maintain scripts to migrate data efficiently, ensuring data quality and consistency.
  • Cloud Platform Expertise:
  • Leverage cloud services (Azure/AWS/GCP) to support data migration and integration efforts.
  • Implement cloud-based storage and compute solutions in conjunction with Databricks.
  • Collaboration & Support:
  • Troubleshoot and resolve issues related to data migration and performance tuning.
  • Collaborate with cross-functional teams (data engineers, architects, DevOps) to ensure seamless migration.
  • Provide post-migration support to ensure the stability of the data platform.

Required Qualifications:

  • Educational Background:
  • Bachelor’s degree in Computer Science, Information Technology, or related field.
  • Experience:
  • 3-5 years of experience in data engineering, with a focus on data migration projects.
  • Hands-on experience in Databricks and Apache Spark.
  • Proven track record of migrating large datasets from on-premise to cloud (Azure/AWS/GCP) or other data platforms.
  • Azure Informatica to Databricks migration

Key Skills:

  • Technical Expertise:
  • Proficient in Databricks, Apache Spark, PySpark, or Scala.
  • Strong experience with cloud platforms: Azure (preferred), AWS, or GCP.
  • Hands-on experience with data migration, data integration, and ETL processes.
  • Strong knowledge of SQL, NoSQL databases, and data warehousing concepts.
  • Familiarity with Hadoop and other big data ecosystems.

Data Pipeline & Tools:

  • Proficiency in data pipeline tools such as Apache Airflow, Talend, or Informatica.
  • Experience with version control systems (e.g., Git).
  • Good understanding of data governance, security, and compliance requirements.
  • Soft Skills:
  • Excellent problem-solving, analytical, and communication skills.
  • Ability to work independently as well as in a collaborative, team environment.
  • Strong attention to detail and commitment to delivering high-quality results.

  • Data Bricks Manager

    1 month ago

    Anywhere in India/Multiple Locations Spectrum Consulting Full time

    Job Title: Data Bricks ManagerAbout the Role:At Spectrum Consulting, we are seeking a highly skilled Data Bricks Manager to lead our team in developing modern data warehouse solutions using Databricks and AWS/Azure Stack. The ideal candidate will have a deep understanding of data engineering and analytics, as well as experience in working with DW/BI leads to...

  • Azure data bricks admin

    3 weeks ago

    India MSRcosmos LLC Full time

    Job Title : Azure Data bricks Admin Experience : 7+ Location : Bangalore, India (Remote) Contract Duration : 6 Months (Contract to Hire) Conversion : Full-time Employment (FTE) after 6 months Job Description : Oversee the design, implementation, and maintenance of Data bricks clusters. Ensure the platform’s scalability, performance,...

  • Corporate Trainer

    6 months ago

    India Koenig Solutions Full time

    **Consider joining Koenig, if the following are important to you**: - Permanent Work from Home. - Time Flexibility (No mandatory 9-5). - A work culture of constant learning & improvement. - Quick promotions. - A Purpose - We help people earn Money, Respect & Peace of Mind. **Koenig is Great Place to Work Certified and has a Rating of 4.2 (out of 5) on...

  • Azure Data bricks Admin

    3 weeks ago

    india MSRcosmos LLC Full time

    Job Title : Azure Data bricks Admin Experience : 7+ Location : Bangalore, India (Remote) Contract Duration : 6 Months (Contract to Hire) Conversion : Full-time Employment (FTE) after 6 months Job Description : Oversee the design, implementation, and maintenance of Data bricks clusters. Ensure the platform’s scalability, performance, and security. Develop...

  • Data Bricks Manager

    4 weeks ago

    Anywhere in India/Multiple Locations SPECTRUM CONSULTING Full time

    Role: Data Bricks ManagerPrimary Responsibilities:- Design and develop modern data warehouse solutions using Databricks and cloud providers.- Contribute to forward-thinking data engineering and analytics projects.- Collaborate with DW/BI leads to understand ETL pipeline development requirements.- Troubleshoot data pipeline issues and implement fixes.-...

  • Data Bricks Manager

    2 months ago

    Anywhere in India/Multiple Locations, IN Spectrum Consulting Full time

    Role : Data Bricks ManagerPrimary Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in...

  • Data Brick

    1 month ago

    India Delphic (South Asia) Full time

    Job Summary : We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects. The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data...

  • Data brick

    1 month ago

    India Delphic Full time

    Job Summary : We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects. The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data...

  • Data Brick

    1 month ago

    India Delphic (South Asia) Full time

    Job Summary:We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects. The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data...

  • Data Brick

    1 month ago

    India Delphic (South Asia) Full time

    Job Summary : We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects. The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data...

  • Senior Data Engineer

    2 months ago

    india ValueLabs Full time

    Dear Aspirants, We at ValueLabs have an Opening for Senior Azure Data Engineer role. Below is the JD for the same. Role: Sr Data Engineer Experience: 5+ Years Preferable Immediate Joiners The Azure Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role...

  • Data Engineer

    1 week ago

    india Live Connections Full time

    Data Engineering Consultant - Azure Cloud, .Python. API. Azure Functions. ADF. Spark.Scala. Azure Data Bricks. SQL Server. ETL Skills CTC - Max 28 LPA

  • Data Engineer

    2 weeks ago

    India Live Connections Full time

    Data Engineering Consultant - Azure Cloud, .Python. API. Azure Functions. ADF. Spark.Scala. Azure Data Bricks. SQL Server. ETL Skills CTC - Max 28 LPA

  • Cloud Data Engineer

    3 weeks ago

    India Tata Consultancy Services Full time

    Role OverviewAzure Data Engineer at Tata Consultancy Services: Design and develop cloud-based data pipelines, warehouses, and lakes, leveraging expertise in Azure Data Bricks, Python scripting, and DevOps CI/CD.Key Responsibilities:Mandatory Skills:Azure Data BricksPython scriptingPySparkStructured StreamingAzure StorageAzure Data FactoryARM templatesDevOps...

  • Live Connections | Data Engineer | india

    1 week ago

    india Live Connections Full time

    Data Engineering Consultant - Azure Cloud, .Python. API. Azure Functions. ADF. Spark.Scala. Azure Data Bricks. SQL Server. ETL Skills CTC - Max 28 LPA

  • Live Connections | Data Engineer | india

    2 weeks ago

    india Live Connections Full time

    Data Engineering Consultant - Azure Cloud, .Python. API. Azure Functions. ADF. Spark.Scala. Azure Data Bricks. SQL Server. ETL Skills CTC - Max 28 LPA

  • Data engineer

    1 month ago

    India Dautom Full time

    Role: Data Support Engineer Client: One of the leading banks in the UAE Job Location: Offshore (anywhere in India) Contract Duration: Minimum 6 months extendable contract (based on job performance and business needs) Technical Skills: Bachelor’s Degree in Computer Science, Information Technology, Data Science, Software Engineering, or a related field....

  • Data Engineer

    1 month ago

    India Dautom Full time

    Role: Data Support Engineer Client: One of the leading banks in the UAE Job Location: Offshore (anywhere in India) Contract Duration: Minimum 6 months extendable contract (based on job performance and business needs) Technical Skills: Bachelor’s Degree in Computer Science, Information Technology, Data Science, Software Engineering, or a related field. 5...

  • Data Engineer

    1 day ago

    India Invent Health Full time

    *** Will be required to report at Chennai Location Office ***About Invent HealthAt Invent Health, we intertwine risk adjustment analytics and machine learning with healthcare data to create actionable insights that bolster our clients’ business outcomes and create a tangible difference in their members’ lives. Our unique solutions provide accurate gap...

  • Data Engineer

    6 hours ago

    India Invent Health Full time

    *** Will be required to report at Chennai Location Office *** About Invent Health At Invent Health, we intertwine risk adjustment analytics and machine learning with healthcare data to create actionable insights that bolster our clients’ business outcomes and create a tangible difference in their members’ lives. Our unique solutions provide accurate gap...