CGI - Data Engineer - Data Pipeline

3 weeks ago

BangaloreHyderabadChennaiPune, India CGI Information Systems and Management Consultants Full time

Required Skills :

- 5+ years of experience in database administration duties

- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline

- Experience in building or maintaining ETL processes.

- Experienced in working with big data analytics tools.

- Need to be proficient in various database types and technologies, such as PostgreSQL, MongoDB, and Cassandra.

- Familiarity with data orchestration tools like Airflow

- Experience with Azure Data Analytics Architecture preferred.

- Experience working with data sourced from REST and/or SOAP APIs preferred.

- Proven track of requirements gathering and analysis, design, development, coding, testing, and implementation providing support for real-time low latency, distributed software systems processing big data sets

- A successful history of manipulating, processing and extracting value from large, disconnected datasets.

- Communication skills, especially for explaining technical concepts to nontechnical business leaders.

What You'll Do :

- Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.

- Help streamline our data science workflows, adding value to our product offerings and building out the customer lifecycle and retention models.

- Writing and optimizing code for data transformation. This could involve cleaning the data, handling missing values, and transforming raw data into a more usable format for analysis or machine learning tasks.

- Ensuring that data pipelines are running smoothly is crucial. You'll monitor performance metrics, troubleshoot any issues, and work on pipeline optimization to improve efficiency and reduce latency.

- Performing statistical analysis and using results to improve models.

- Participate in designing and implementing RESTful services and microservices

- Define guidelines and best practices to drive consistency across client implementation and make sure consistency is followed across the board.

- Installs, supports, upgrades, and maintains database environments like MongoDB and Postgres

- Supports database best practices relative to tuning, object creation, monitoring, security, logging, and auditing techniques while sharing knowledge and collaborating with others in IT to deliver effective application solutions in a solid operational environment

- Assist in developing best BI and data services deployment practices such as Azure Data Factories and Azure CI/CD pipelines, including development, governance and maintenance

- Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.

- Ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements.

(ref:hirist.tech)

  • CGI - Data Engineer - Python/Hadoop

    1 week ago

    Bangalore/Chennai/Pune/Hyderabad/Mumbai, India CGI Full time

    Job Title : Data Engineer SSE Work Location : Bangalore/Chennai/Pune/Hyderabad/Mumbai (Any CGI location). - Data pipeline/workflow development in GCP, Hadoop, Kubernetes, ELK - Supporting existing production applications - Assist in connectivity and environment development The candidate will need to understand the requirements and work mostly...

  • CGI - Data Engineer - Data Pipeline

    2 weeks ago

    Bangalore/Hyderabad/Chennai/Pune, IN CGI Information Systems and Management Consultants Full time

    Required Skills :- 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...

  • CGI - Data Engineer - Data Pipeline

    1 week ago

    Hyderabad, India CGI Information Systems and Management Consultants Full time

    Required Skills :- 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...

  • CGI - Data Engineer - Data Pipeline

    3 weeks ago

    pune, India CGI Information Systems and Management Consultants Full time

    Required Skills : - 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...

  • Data Architect

    21 hours ago

    Pune, Maharashtra, India CGI Full time

    Exp: 4+ years Location: Pune **Job Description**: Primary Skills (Technical Must Haves) - Very good exp in designing data and AI products - Have strong experience in designing and implementing medallion Datalake architecture - Strong experience in handling PII data and legal regulations - Having experience in Data governance and Data Modelling - Very...

  • Senior Data Engineer

    3 days ago

    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    3 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Azure Data Engineer

    2 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • CGI - Azure Data Engineer - Data Factory & Databricks

    2 weeks ago

    Bangalore, Karnataka, India CGI Full time

    Job Title : Azure Data EngineerExperience : 4 to 10 yearsCategory : Software Development/ EngineeringLocation : Bangalore onlyNotice Period: Immediate / Max 30 DaysEmployment Type : Full TimeQualifying Criteria :- 4+ years of experience in Azure Data Engineer - ADF, ADB, ADLS- Notice period / Joining duration - Immediately / Less than 30 Days- Willing to...

  • CGI - Azure Data Engineer - Data Factory & Databricks

    3 weeks ago

    Bangalore, India CGI Full time

    Job Title : Azure Data EngineerExperience : 4 to 10 yearsCategory : Software Development/ EngineeringLocation : Bangalore onlyNotice Period: Immediate / Max 30 DaysEmployment Type : Full TimeQualifying Criteria :- 4+ years of experience in Azure Data Engineer - ADF, ADB, ADLS- Notice period / Joining duration - Immediately / Less than 30 Days- Willing to...

  • Senior Azure Data Engineer

    3 weeks ago

    hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Azure Data Engineer

    3 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Wavicle Data Solutions

    1 week ago

    Chennai/Coimbatore, India Wavicle data solutions Full time

    Job Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • Data Engineer

    1 week ago

    Pune, India BRISKWIN IT SOLUTIONS PRIVATE LIMITED Full time

    Job Description :Role : Azure Data EngineerLocation : PuneRole Description :In the Azure Data Engineer capacity, you will be member of our Business Intelligence development team. - You will help design, implement, and maintain data pipelines with complex data transformations. In addition, you will support our data architect & modeler, and BI Analysts on...

  • Senior Data Engineer

    3 weeks ago

    Bangalore,Hyderabad,Pune, India LAGNUS PRIVATE LIMITED Full time

    About the job : ROLE : Snowflake and Matillion Data Engineer JD : Experience : 4 to 6 Years Overview : - Design, implement, and optimize data pipelines and workflows using Snowflake and Matillion to support our data integration, transformation, and analytics initiatives.- Collaborate with cross-functional teams to gather requirements, define data models,...

  • Senior Data Engineer

    2 weeks ago

    Bangalore/Hyderabad/Pune, IN LAGNUS PRIVATE LIMITED Full time

    About the job : ROLE : Snowflake and Matillion Data Engineer JD : Experience : 4 to 6 Years Overview :- Design, implement, and optimize data pipelines and workflows using Snowflake and Matillion to support our data integration, transformation, and analytics initiatives.- Collaborate with cross-functional teams to gather requirements, define data models, and...

  • Power Bi

    1 week ago

    Pune, Maharashtra, India CGI Full time

    Company Profile: Job Title: Power BI Developer Position ID : J0124-1100 Experience: 8+ Years Category: Software Development/ Engineering Main location: India, Karnataka, Bangalore Position ID: Employment Type: Full Time Qualification: Bachelor's degree in Computer Science or related field or higher with relevant experience. **Responsibilities**: Position...

  • Lead Data Engineer

    2 days ago

    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Lead Data Engineer

    1 day ago

    Bangalore/Pune/Hyderabad/Chennai, India Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • GCP Data Engineer

    7 days ago

    Pune, India CGI Full time

    Position Description:Job Description/ Position DescriptionWorks independently under limited supervision and applies knowledge of subject matter in Applications Development. Possess sufficient knowledge and skills to effectively deal with issues, challenges within field of specialization to develop simple applications solutions. Second level professional with...