Data Engineer

4 weeks ago

Pune, India The Citco Group Limited Full time

About Citco

Since the 1940s Citco has provided specialist financial services to alternative investment funds, investors, multinationals and private clients worldwide. With over 6,000 employees in 45 countries we pioneer innovative solutions that meet our clients’ evolving needs and deliver exceptional service.


About the Role:

The Data Engineering will be a key member of the Operations Data Lake (ODL) team and will be responsible for overseeing the design, development, and optimization of data pipelines to ingest structured and unstructured data in the lake. The incumbent will play a pivotal role in supporting multiple domain teams to create organizational data assets while ensuring data integrity, security and implementing centralized governance.


Job Duties in Brief:

  • Lead and manage multiple data projects leveraging Databricks, from project initiation to completion, ensuring adherence to project timelines, budget, and quality standards.
  • Collaborate closely with cross-functional teams including Subject Matter Experts, data scientists, engineers, analysts, and other stakeholders to define project requirements, scope, and deliverables.
  • Define and implement scalable and robust data lake architectures leveraging Databricks Delta Lake technology
  • Design data ingestion, transformation, and storage strategies to ensure efficient and reliable data management
  • Oversee the development of data pipelines to ingest, process, and transform data from various sources into Databricks Delta Lake
  • Define data models and schemas to support analytical and reporting needs.
  • Optimize data structures, partitioning strategies, and storage formats for efficient query performance
  • Implement ML pipelines and workflows for model training, validation, and deployment using Databricks MLflow and related tools to support real-time and batch inference.
  • Work closely with BI Analysts and Data Visualization specialists to design and optimize data schemas and structures for BI reporting and analytics.
  • Establish monitoring and alerting mechanisms to proactively detect issues and optimize data lake performance
  • Stay abreast of industry trends, best practices, and emerging technologies in data engineering and Databricks Delta Lake
  • Provide technical guidance and leadership on Databricks best practices, methodologies, and implementation strategies.
  • Manage Databricks clusters and resources efficiently to optimize performance, scalability, and cost-effectiveness.
  • Develop and maintain metadata management solutions to capture, organize, and govern data assets across the organization.



About You:

  • Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field. Advanced degree preferred.
  • Excellent communication, interpersonal, and leadership skills, with the ability to effectively collaborate with diverse teams and stakeholders.
  • Strong analytical and problem-solving abilities, with a focus on delivering innovative and impactful data-driven solutions.
  • 3-8 years of hands-on experience in leading data engineering projects in Databricks.
  • Deep expertise in Apache Spark, Databricks runtime environment, and Databricks Delta Lake
  • Professional/Associate level Databricks certification is required.
  • Strong understanding of master data management principles, metadata management, and data cataloging concepts and best practices.
  • Strong background in data modeling, ETL/ELT development, and data warehousing.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform and big data technologies.


Assets:

  • Financial product knowledge and knowledge of Hedge Fund Administration
  • Experience in setting up and managing Data Center of Excellence (CoE) is highly desirable
  • Create interactive reports in Qlik/Tableau/Power BI/Alteryx
  • Experience integrating machine learning models and algorithms into data pipelines (experience with Databricks MLflow is a plus).
  • Experience working in an Agile environment with knowledge of JIRA, Confluence etc

  • Senior Data Engineer

    1 hour ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Senior Data Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    1 week ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Scientist

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Scientist

    1 week ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Software Engineer

    1 week ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Software Engineer

    3 weeks ago

    Pune, India Data Axle Full time

    Job DescriptionAbout Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and...

  • Software Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Software Engineer

    1 week ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Software Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Software Engineer

    3 weeks ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    2 days ago

    Pune, India Unify Dots Full time

    Job DescriptionDesign, construct, install, test, and maintain highly scalable data management systems.Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI.Ensure systems meet business requirements and industry practices by...

  • Senior Software Engineer – Fullstack

    3 weeks ago

    Pune, India Crest Data Systems Full time

    Job Description:We are looking for software engineers to join our engineering team in Ahmedabad & Pune. The primary responsibility will be to help design and develop Enterprise Software for our Global Fortune 500 clients in Data Analytics, Security, and Cloud segments. The job requires an understanding of backend & frontend programming languages such as Core...

  • Data Engineer

    6 days ago

    Pune, India Unify Dots Full time

    Job DescriptionDesign, construct, install, test, and maintain highly scalable data management systems. Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI. Ensure systems meet business requirements and industry practices by...

  • Data Engineer

    6 days ago

    pune, India Unify Dots Full time

    Job DescriptionDesign, construct, install, test, and maintain highly scalable data management systems.  Implement complex data warehousing projects with a focus on collecting, parsing, managing, analyzing, and visualizing large datasets to turn information into insights using Power BI.  Ensure systems meet business requirements and industry practices by...

  • Data Engineer

    2 weeks ago

    pune, India Synechron Full time

    Good day,We have immediate opportunity for Data Analytics Engineer.Job Role: Data Analytics EngineerJob Location: Kharadi, PuneExperience- 8 Years to 12 Years.Notice Period: upto 30 days.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative...

  • Data Engineer

    1 week ago

    Pune, India Sigmaways Inc Full time

    This position is a Hybrid Role candidate should be 2 days onsite in Pune Office ( Prefer Local candidates).Position : Data EngineerType : Long Term Contract RoleLocation : Pune / HybridJob Description:1. This position is for Data warehouse group .2. This position is a Data Engineer position but someone with hands on strong in programming language .3. Someone...

  • Data Engineer

    2 weeks ago

    Pune, India Synechron Full time

    Good day,We have immediate opportunity for Data Analytics Engineer.Job Role:Data Analytics EngineerJob Location:Kharadi, PuneExperience-8 Years to 12 Years.Notice Period:upto 30 days.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology...

  • Data Engineer

    2 weeks ago

    Pune, India Synechron Full time

    Good day,We have immediate opportunity for Data Analytics Engineer.Job Role:Data Analytics EngineerJob Location:Kharadi, PuneExperience-8 Years to 12 Years.Notice Period:upto 30 days.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology...

  • Data Engineer

    1 week ago

    pune, India Tech Mahindra Full time

    Title: Reltio GCP Data EngineerLocation: PuneExperience: 6+yearsNP: Immediate to 15daysCompany Profile:Tech Mahindra represents the connected world, offering innovative and customer-centric information technology experiences. We #Rise together to create sustainable businesses that can bring about lasting change in our communities – to create an equal...