Databricks Senior Data Engineer

1 month ago

delhi, India Luxoft Full time
Project description
We are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of this fast-paced and exciting journey, this project should be top of the list
This role will be primarily responsible for closely collaborating with a business SME to implement data validation rules.
Responsibilities
Collaborating with a business SME to implement data validation rules.
Understand business requirements and actively provide input from a data perspective.
Understand the underlying data and flow of data.
Understand overall platform architecture and capabilities and how to load data effectively.
Recognize and adapt to the changes in processes.
Skills
Must have
7 years + of relevant experience.
Proficient hands-on experience with Azure Databricks (3y+).
Proficiency in Python and PySpark (5y+).
Advanced knowledge in SQL (5y+).
Should be able to analyse and understand complex data.
Knowledge of Azure data/delta lake, Azure DevOps, CI/CD, and Git is essential.
Should clearly understand the data platform lifecycle and contribute to preparing Design documents, Unit Test plans, and Code review reports.
Knowledge of data Lake house and business intelligence architecture.
Experience working in an Agile environment (Scrum, Agile) is a plus.
Interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.
Bachelor's degree in IT/Computer Science or related field
Nice to have
Knowledge of the financial markets, portfolio theory, and risk management is a plus
Other
Languages
English: C1 Advanced
Seniority
Senior

  • Data Warehouse Engineer | Data Warehouse Engineer | delhi

    2 weeks ago

    delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Engineer

    2 weeks ago

    Delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Architect : Big Data

    6 months ago

    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Senior Data Integration Engineer | Senior Data Integration Engineer | delhi

    2 weeks ago

    delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    2 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    2 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...

  • Senior data integration engineer

    2 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Architect

    3 weeks ago

    Delhi, Delhi, India Prime Ideas Consultancy Full time

    Job Title: Senior Data Architect - Databricks ExpertLocation: Remote, IndiaEstimated Salary: ₹30,00,000 - ₹50,00,000 per annumAbout Us: Prime Ideas Consultancy is a leading provider of data engineering solutions in the Azure ecosystem.Job Description:Data Engineering Expertise: As a Senior Data Architect - Databricks Expert, you will be responsible for...

  • Databricks - Data Engineer

    1 month ago

    Delhi, India EliteRecruitments Full time

    Job opportunity for data engineers for Gurgaon locationExperience: 5+ yearsShould have good experience in databricks.Role & Responsibilities Overview:A seasoned data team member with a good grasp of both business and technical aspects. Familiarity with data stackInteract with the other members of the data governance team,business teams to understand...

  • Senior Data Engineer

    2 weeks ago

    Delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: PuneJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive enterprise-wide...

  • Databricks - Data Engineer

    1 month ago

    Delhi, India EliteRecruitments Full time

    Job opportunity for data engineers for Gurgaon locationExperience: 5+ yearsShould have good experience in databricks.Role & Responsibilities Overview:- A seasoned data team member with a good grasp of both business and technical aspects. Familiarity with data stack- Interact with the other members of the data governance team,business teams to understand...

  • Senior Big Data Engineer

    3 days ago

    Delhi, Delhi, India Knack Consulting Services Pvt Ltd. Full time

    About the RoleWe are seeking a highly skilled Senior Big Data Engineer with expertise in Databricks to join our team at Knack Consulting Services Pvt. Ltd.

  • Databricks - Data Engineer

    1 month ago

    delhi, India EliteRecruitments Full time

    Job opportunity for data engineers for Gurgaon locationExperience: 5+ yearsShould have good experience in databricks.Role & Responsibilities Overview:A seasoned data team member with a good grasp of both business and technical aspects. Familiarity with data stackInteract with the other members of the data governance team,business teams to understand...

  • Data Engineer

    4 weeks ago

    delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks) Location: Bangalore / Hybrid Job Type: Full-time Job Description: Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data Engineer

    1 month ago

    delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks) Location: Bangalore / Hybrid Job Type: Full-time Job Description: Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data Engineer

    1 month ago

    delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data Engineer

    4 weeks ago

    delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data Engineer

    1 month ago

    delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data engineer

    1 month ago

    Delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data Engineer

    4 weeks ago

    Delhi, India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks)Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...