Capco - Data Engineer - ETL/Azure Databricks

4 weeks ago

Pune, India Capco Technologies Pvt Ltd Full time

Senior Consultant - Data Engineer

Experience : 8+ Years

Employment Type : Full-time

Job Overview :

We are seeking a highly skilled Senior Consultant - Data Engineer with 8+ years of experience, particularly within the Financial Services sector. You will be instrumental in designing, building, and optimizing data pipelines and ETL processes in Azure Databricks, ensuring high performance, reliability, and scalability. This role demands a commitment to strategic, optimal solutions, strong technical skills in SQL, Python, and PySpark, and the ability to collaborate effectively within an Agile team to deliver robust data solutions for our clients.

Responsibilities :

- Design, build, and optimize data pipelines and ETL processes specifically within Azure Databricks, ensuring high performance, reliability, and scalability for large datasets.

- Implement best practices for data ingestion, transformation, and cleansing to ensure exceptional data quality and integrity across all stages of the pipeline.

- Adhere strictly to client's best practice guidelines as set out by the Data Engineering Lead, ensuring architectural consistency and operational excellence.

- Collaborate closely with data modelers and testers to ensure that data pipelines are implemented correctly and meet all specified requirements.

- Work as an integral part of a cross-functional Agile team to understand complex business requirements and translate them into efficient and effective technical data solutions.
- Demonstrate a continual desire to implement strategic or optimal data solutions, actively avoiding workarounds or short-term tactical approaches wherever possible.

Role Requirements :

- Strong Data Engineer with extensive experience, particularly within the Financial Services industry.

- Proven knowledge of and hands-on experience building data pipelines in Azure Databricks.

- A strong commitment to implementing "strategic" or "optimal" solutions, prioritizing long-term maintainability and performance over quick fixes.

- Experience working effectively within an Agile team :

- 8+ years of experience in data engineering roles.

- Strong proficiency in SQL, Python, and PySpark.

- Good knowledge of Azure Databricks, including a solid understanding of delta tables, Apache Spark, and Unity Catalog.

- Extensive experience in writing, optimizing, and analyzing SQL and PySpark code, coupled with a robust capability to interpret complex data requirements and architect scalable solutions.

- Good knowledge of the Software Development Life Cycle (SDLC).

- Familiarity with Agile/Scrum ways of working.

- Strong verbal and written communication skills, capable of articulating complex technical concepts to diverse audiences.

- Ability to manage multiple priorities effectively and deliver high-quality solutions to tight deadlines.


(ref:hirist.tech)

  • Capco - Azure Databricks Platform Engineer - Insurance Data Infrastructure

    4 weeks ago

    Pune, India Capco Technologies Pvt Ltd Full time

    Azure Databricks Platform Engineer - Insurance Data InfrastructureLocation : Pune / Bangalore/ Mumbai/ Chennai/ Hyderabad/ GurugramBand : M3/M4 (7 to 14 years)Key Responsibilities : - Azure Databricks Platform Engineering - Design, deploy, and manage secure, scalable, and high-performance Databricks environments for insurance data processing and analytics.-...

  • Azure DataBricks Engineer

    3 weeks ago

    Pune, India Wipro Full time

    Role OverviewWe are looking for a seasoned Azure Data Engineer with strong experience in building and optimizing data pipelines, preferably on Azure. The candidate should be proficient in Databricks, Spark, and Python, and capable of designing scalable data solutions for big data analytics. Key Responsibilities Design, develop, and maintain ETL pipelines...

  • Azure DataBricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Wipro Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role OverviewWe are looking for a seasoned Azure Data Engineer with strong experience in building and optimizing data pipelines, preferably on Azure. The candidate should be proficient in Databricks, Spark, and Python, and capable of designing scalable data solutions for big data analytics.Key ResponsibilitiesDesign, develop, and maintain ETL pipelines using...

  • Azure Databricks Engineer

    3 weeks ago

    Pune, India Symphoni Hr Full time

    Locations: Pune, Maharashtra, India Minimum Experience: 5 Maximum Experience: 12 ctc lac lac max Skill Set: Databricks Engineer, Azure Databricks, SQL, Pyspark Skill to Evaluate: Databricks Engineer, Azure Databricks, SQL Experience: 5 to 12 Years Location: Pune, Maharashtra, India Job Description: Job Title: Senior Data Engineer Key Responsibilities:-...

  • Azure Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 6,00,000 - ₹ 24,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:6ctc 6+ upto 24 lacSkill Set:Databricks Engineer, Azure Databricks, SQL, PythonSkill to Evaluate:Databricks Engineer, Azure Databricks, SQL,Pyspark, Python, Team HandlingExperience:8 to 14 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design,...

  • Azure Databricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:5Maximum Experience:12ctc lac lac maxSkill Set:Databricks Engineer, Azure Databricks, SQL, PysparkSkill to Evaluate:Databricks Engineer, Azure Databricks, SQLExperience:5 to 12 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design, build, and...

  • Azure Databricks Developer

    4 weeks ago

    Pune, India People Prime World Wide Full time

    About Client :Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus...

  • Azure Data Engineer

    6 days ago

    Pune, India T D Newton Full time

    Description : - Urgent requirement for Azure Data Engineer for Bangalore and Pune Location. Experience : - 4-10 Years Job Location : - Pune/Bangalore Job Description : - Bachelors or higher degree in Computer Science or a related discipline; or equivalent (minimum 4+ years work experience). - At least 6+ years of consulting or client service delivery...

  • CodeZio - Azure Data Engineer - ETL

    3 weeks ago

    Pune, India CodeZio Full time

    Job Title : Azure Data EngineerLocation : Bangalore / Pune (On-site)Employment Type : Full-timeExperience : 5-9 yearsAbout the Role :We are looking for an experienced Azure Data Engineer to design, build, and optimize large-scale data pipelines and cloud-based data solutions. The ideal candidate will have strong expertise in Microsoft Azure data services,...

  • Senior Data Engineer

    4 weeks ago

    Pune, India Timus Consulting services Full time

    Job Title : Senior Data EngineerLocation : PuneJob Type : Full-TimeIIT Graduates onlyJob Description : We are looking for a Senior Data Engineer with strong expertise in Azure Databricks, PySpark, and distributed computing to develop and optimize scalable ETL pipelines for manufacturing analytics. The role involves working with high-frequency industrial...