Data brick

1 month ago

India Delphic Full time

Job Summary : We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects.

The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data integration tools.

You will play a key role in designing, executing, and optimizing data migration pipelines to ensure a smooth and efficient transition to the Databricks platform.

Key Responsibilities : Data Migration : Lead and execute data migration projects to Databricks from legacy systems (on-premises/cloud-based).

Design, build, and maintain efficient data pipelines using Apache Spark on Databricks.

Optimize the performance of ETL jobs, ensuring high availability and scalability.

Data Architecture & Integration : Collaborate with data architects and stakeholders to design effective data migration strategies.

Work closely with teams to understand business requirements and data sources.

Develop and maintain scripts to migrate data efficiently, ensuring data quality and consistency.

Cloud Platform Expertise : Leverage cloud services (Azure/AWS/GCP) to support data migration and integration efforts.

Implement cloud-based storage and compute solutions in conjunction with Databricks.

Collaboration & Support : Troubleshoot and resolve issues related to data migration and performance tuning.

Collaborate with cross-functional teams (data engineers, architects, Dev Ops) to ensure seamless migration.

Provide post-migration support to ensure the stability of the data platform.

Required Qualifications : Educational Background : Bachelor’s degree in Computer Science, Information Technology, or related field.

Experience : 3-5 years of experience in data engineering, with a focus on data migration projects.

Hands-on experience in Databricks and Apache Spark.

Proven track record of migrating large datasets from on-premise to cloud (Azure/AWS/GCP) or other data platforms.

Azure Informatica to Databricks migration Key Skills : Technical Expertise : Proficient in Databricks, Apache Spark, Py Spark, or Scala.

Strong experience with cloud platforms: Azure (preferred), AWS, or GCP.

Hands-on experience with data migration, data integration, and ETL processes.

Strong knowledge of SQL, No SQL databases, and data warehousing concepts.

Familiarity with Hadoop and other big data ecosystems.

Data Pipeline & Tools : Proficiency in data pipeline tools such as Apache Airflow, Talend, or Informatica.

Experience with version control systems (e.g., Git).

Good understanding of data governance, security, and compliance requirements.

Soft Skills : Excellent problem-solving, analytical, and communication skills.

Ability to work independently as well as in a collaborative, team environment.

Strong attention to detail and commitment to delivering high-quality results.

  • Data Bricks Manager

    1 month ago

    Anywhere in India/Multiple Locations Spectrum Consulting Full time

    Job Title: Data Bricks ManagerAbout the Role:At Spectrum Consulting, we are seeking a highly skilled Data Bricks Manager to lead our team in developing modern data warehouse solutions using Databricks and AWS/Azure Stack. The ideal candidate will have a deep understanding of data engineering and analytics, as well as experience in working with DW/BI leads to...

  • Azure data bricks admin

    3 weeks ago

    India MSRcosmos LLC Full time

    Job Title : Azure Data bricks Admin Experience : 7+ Location : Bangalore, India (Remote) Contract Duration : 6 Months (Contract to Hire) Conversion : Full-time Employment (FTE) after 6 months Job Description : Oversee the design, implementation, and maintenance of Data bricks clusters. Ensure the platform’s scalability, performance,...

  • Corporate Trainer

    6 months ago

    India Koenig Solutions Full time

    **Consider joining Koenig, if the following are important to you**: - Permanent Work from Home. - Time Flexibility (No mandatory 9-5). - A work culture of constant learning & improvement. - Quick promotions. - A Purpose - We help people earn Money, Respect & Peace of Mind. **Koenig is Great Place to Work Certified and has a Rating of 4.2 (out of 5) on...

  • Azure Data bricks Admin

    3 weeks ago

    india MSRcosmos LLC Full time

    Job Title : Azure Data bricks Admin Experience : 7+ Location : Bangalore, India (Remote) Contract Duration : 6 Months (Contract to Hire) Conversion : Full-time Employment (FTE) after 6 months Job Description : Oversee the design, implementation, and maintenance of Data bricks clusters. Ensure the platform’s scalability, performance, and security. Develop...

  • Data Bricks Manager

    4 weeks ago

    Anywhere in India/Multiple Locations SPECTRUM CONSULTING Full time

    Role: Data Bricks ManagerPrimary Responsibilities:- Design and develop modern data warehouse solutions using Databricks and cloud providers.- Contribute to forward-thinking data engineering and analytics projects.- Collaborate with DW/BI leads to understand ETL pipeline development requirements.- Troubleshoot data pipeline issues and implement fixes.-...

  • Data Bricks Manager

    2 months ago

    Anywhere in India/Multiple Locations, IN Spectrum Consulting Full time

    Role : Data Bricks ManagerPrimary Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in...

  • Data Brick

    1 month ago

    India Delphic (South Asia) Full time

    Job Summary : We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects. The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data...

  • Data Brick

    1 month ago

    India Delphic (South Asia) Full time

    Job Summary : We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects. The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data...

  • Data Brick

    1 month ago

    india Delphic (South Asia) Full time

    Job Summary:We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects. The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data...

  • Data Brick

    1 month ago

    India Delphic (South Asia) Full time

    Job Summary:We are seeking a skilled Databricks Migration Engineer with 3-5 years of experience in data engineering and cloud migration projects. The ideal candidate will have hands-on experience in migrating large datasets from legacy systems to the Databricks platform, with expertise in Apache Spark, cloud environments (AWS, Azure, GCP), and data...

  • Senior Data Engineer

    2 months ago

    india ValueLabs Full time

    Dear Aspirants, We at ValueLabs have an Opening for Senior Azure Data Engineer role. Below is the JD for the same. Role: Sr Data Engineer Experience: 5+ Years Preferable Immediate Joiners The Azure Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role...

  • Data Engineer

    1 week ago

    india Live Connections Full time

    Data Engineering Consultant - Azure Cloud, .Python. API. Azure Functions. ADF. Spark.Scala. Azure Data Bricks. SQL Server. ETL Skills CTC - Max 28 LPA

  • Data Engineer

    2 weeks ago

    India Live Connections Full time

    Data Engineering Consultant - Azure Cloud, .Python. API. Azure Functions. ADF. Spark.Scala. Azure Data Bricks. SQL Server. ETL Skills CTC - Max 28 LPA

  • Cloud Data Engineer

    3 weeks ago

    India Tata Consultancy Services Full time

    Role OverviewAzure Data Engineer at Tata Consultancy Services: Design and develop cloud-based data pipelines, warehouses, and lakes, leveraging expertise in Azure Data Bricks, Python scripting, and DevOps CI/CD.Key Responsibilities:Mandatory Skills:Azure Data BricksPython scriptingPySparkStructured StreamingAzure StorageAzure Data FactoryARM templatesDevOps...

  • Live Connections | Data Engineer | india

    1 week ago

    india Live Connections Full time

    Data Engineering Consultant - Azure Cloud, .Python. API. Azure Functions. ADF. Spark.Scala. Azure Data Bricks. SQL Server. ETL Skills CTC - Max 28 LPA

  • Live Connections | Data Engineer | india

    2 weeks ago

    india Live Connections Full time

    Data Engineering Consultant - Azure Cloud, .Python. API. Azure Functions. ADF. Spark.Scala. Azure Data Bricks. SQL Server. ETL Skills CTC - Max 28 LPA

  • Data Engineer

    1 month ago

    India Dautom Full time

    Role: Data Support Engineer Client: One of the leading banks in the UAE Job Location: Offshore (anywhere in India) Contract Duration: Minimum 6 months extendable contract (based on job performance and business needs) Technical Skills: Bachelor’s Degree in Computer Science, Information Technology, Data Science, Software Engineering, or a related field. 5...

  • Data engineer

    1 month ago

    India Dautom Full time

    Role: Data Support Engineer Client: One of the leading banks in the UAE Job Location: Offshore (anywhere in India) Contract Duration: Minimum 6 months extendable contract (based on job performance and business needs) Technical Skills: Bachelor’s Degree in Computer Science, Information Technology, Data Science, Software Engineering, or a related field....

  • Data Engineer

    1 day ago

    India Invent Health Full time

    *** Will be required to report at Chennai Location Office ***About Invent HealthAt Invent Health, we intertwine risk adjustment analytics and machine learning with healthcare data to create actionable insights that bolster our clients’ business outcomes and create a tangible difference in their members’ lives. Our unique solutions provide accurate gap...

  • Data Engineer

    6 hours ago

    India Invent Health Full time

    *** Will be required to report at Chennai Location Office *** About Invent Health At Invent Health, we intertwine risk adjustment analytics and machine learning with healthcare data to create actionable insights that bolster our clients’ business outcomes and create a tangible difference in their members’ lives. Our unique solutions provide accurate gap...