CGI - Data Engineer - Data Pipeline

4 weeks ago

Pune, India CGI Information Systems and Management Consultants Full time

Required Skills :

- 5+ years of experience in database administration duties

- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline

- Experience in building or maintaining ETL processes.

- Experienced in working with big data analytics tools.

- Need to be proficient in various database types and technologies, such as PostgreSQL, MongoDB, and Cassandra.

- Familiarity with data orchestration tools like Airflow

- Experience with Azure Data Analytics Architecture preferred.

- Experience working with data sourced from REST and/or SOAP APIs preferred.

- Proven track of requirements gathering and analysis, design, development, coding, testing, and implementation providing support for real-time low latency, distributed software systems processing big data sets

- A successful history of manipulating, processing and extracting value from large, disconnected datasets.

- Communication skills, especially for explaining technical concepts to nontechnical business leaders.

What You'll Do :

- Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.

- Help streamline our data science workflows, adding value to our product offerings and building out the customer lifecycle and retention models.

- Writing and optimizing code for data transformation. This could involve cleaning the data, handling missing values, and transforming raw data into a more usable format for analysis or machine learning tasks.

- Ensuring that data pipelines are running smoothly is crucial. You'll monitor performance metrics, troubleshoot any issues, and work on pipeline optimization to improve efficiency and reduce latency.

- Performing statistical analysis and using results to improve models.

- Participate in designing and implementing RESTful services and microservices

- Define guidelines and best practices to drive consistency across client implementation and make sure consistency is followed across the board.

- Installs, supports, upgrades, and maintains database environments like MongoDB and Postgres

- Supports database best practices relative to tuning, object creation, monitoring, security, logging, and auditing techniques while sharing knowledge and collaborating with others in IT to deliver effective application solutions in a solid operational environment

- Assist in developing best BI and data services deployment practices such as Azure Data Factories and Azure CI/CD pipelines, including development, governance and maintenance

- Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.

- Ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements.

(ref:hirist.tech)

  • CGI - Data Engineer - Python/Hadoop

    1 week ago

    Bangalore/Chennai/Pune/Hyderabad/Mumbai, India CGI Full time

    Job Title : Data Engineer SSE Work Location : Bangalore/Chennai/Pune/Hyderabad/Mumbai (Any CGI location). - Data pipeline/workflow development in GCP, Hadoop, Kubernetes, ELK - Supporting existing production applications - Assist in connectivity and environment development The candidate will need to understand the requirements and work mostly...

  • CGI - Data Engineer - Data Pipeline

    4 weeks ago

    pune, India CGI Information Systems and Management Consultants Full time

    Required Skills : - 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...

  • CGI - Data Engineer - Data Pipeline

    3 weeks ago

    Bangalore/Hyderabad/Chennai/Pune, IN CGI Information Systems and Management Consultants Full time

    Required Skills :- 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...

  • CGI - Data Engineer - Data Pipeline

    1 week ago

    Bangalore/Hyderabad/Chennai/Pune, India CGI Information Systems and Management Consultants Full time

    Required Skills : - 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...

  • Data Architect

    1 day ago

    Pune, Maharashtra, India CGI Full time

    Exp: 4+ years Location: Pune **Job Description**: Primary Skills (Technical Must Haves) - Very good exp in designing data and AI products - Have strong experience in designing and implementing medallion Datalake architecture - Strong experience in handling PII data and legal regulations - Having experience in Data governance and Data Modelling - Very...

  • Senior Data Engineer

    4 days ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    3 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    1 week ago

    Pune, India BRISKWIN IT SOLUTIONS PRIVATE LIMITED Full time

    Job Description :Role : Azure Data EngineerLocation : PuneRole Description :In the Azure Data Engineer capacity, you will be member of our Business Intelligence development team. - You will help design, implement, and maintain data pipelines with complex data transformations. In addition, you will support our data architect & modeler, and BI Analysts on...

  • Power Bi

    1 week ago

    Pune, Maharashtra, India CGI Full time

    Company Profile: Job Title: Power BI Developer Position ID : J0124-1100 Experience: 8+ Years Category: Software Development/ Engineering Main location: India, Karnataka, Bangalore Position ID: Employment Type: Full Time Qualification: Bachelor's degree in Computer Science or related field or higher with relevant experience. **Responsibilities**: Position...

  • GCP Data Engineer

    1 week ago

    Pune, India CGI Full time

    Position Description:Job Description/ Position DescriptionWorks independently under limited supervision and applies knowledge of subject matter in Applications Development. Possess sufficient knowledge and skills to effectively deal with issues, challenges within field of specialization to develop simple applications solutions. Second level professional with...

  • GCP Data Engineer

    1 week ago

    Pune, India CGI Full time

    Position Description: Job Description/ Position DescriptionWorks independently under limited supervision and applies knowledge of subject matter in Applications Development. Possess sufficient knowledge and skills to effectively deal with issues, challenges within field of specialization to develop simple applications solutions. Second level...

  • GCP Data Engineer

    1 week ago

    pune, India CGI Full time

    Position Description: Job Description/ Position DescriptionWorks independently under limited supervision and applies knowledge of subject matter in Applications Development. Possess sufficient knowledge and skills to effectively deal with issues, challenges within field of specialization to develop simple applications solutions. Second level...

  • Senior Data Scientist

    4 days ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based...

  • Senior Data Scientist

    4 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Cloud Data Engineer

    1 week ago

    Pune, India Amk technologies Full time

    Job Description :We are seeking a talented and motivated Cloud Data Engineer to join our dynamic team.As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on Azure Cloud Platform. You will work closely with cross-functional teams to ensure efficient data flow and integration across...

  • Data Engineer

    1 week ago

    Pune, India Hashone Careers Full time

    Job Description : As a Data Engineer at Purview Services, you will play a key role in designing, implementing, and optimizing our data infrastructure to support business intelligence, analytics, and machine learning initiatives. You will collaborate with cross-functional teams to understand data requirements, develop scalable solutions, and ensure data...

  • eInfochips - AWS Data Engineer - Data Pipeline

    3 weeks ago

    Pune/Ahmedabad/Bangalore/Indore, IN eInfochips Full time

    Role : AWS Data EngineerExperience : 5+ yearsLocation : Pune/Ahmedabad/Indore/ bangaloreCompany Overview :eInfochips, an Arrow company, is a global leader in product engineering and semiconductor design services. Renowned for our technological innovations, we've developed over 500 products, achieving 40M deployments across 140 countries. Our expertise...

  • eInfochips - AWS Data Engineer - Data Pipeline

    1 week ago

    Pune/Ahmedabad/Bangalore/Indore, India eInfochips (An Arrow Company) Full time

    Role : AWS Data EngineerExperience : 5+ yearsLocation : Pune/Ahmedabad/Indore/ bangaloreCompany Overview :eInfochips, an Arrow company, is a global leader in product engineering and semiconductor design services. Renowned for our technological innovations, we've developed over 500 products, achieving 40M deployments across 140 countries. Our expertise...

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Hyderabad/Pune, IN LAGNUS PRIVATE LIMITED Full time

    About the job : ROLE : Snowflake and Matillion Data Engineer JD : Experience : 4 to 6 Years Overview :- Design, implement, and optimize data pipelines and workflows using Snowflake and Matillion to support our data integration, transformation, and analytics initiatives.- Collaborate with cross-functional teams to gather requirements, define data models, and...

  • Senior Data Engineer

    3 weeks ago

    Bangalore,Hyderabad,Pune, India LAGNUS PRIVATE LIMITED Full time

    About the job : ROLE : Snowflake and Matillion Data Engineer JD : Experience : 4 to 6 Years Overview : - Design, implement, and optimize data pipelines and workflows using Snowflake and Matillion to support our data integration, transformation, and analytics initiatives.- Collaborate with cross-functional teams to gather requirements, define data models,...