Data Engineer

2 months ago

kolkata, India Change leaders Full time

Primary Skill :


- GCP + Python + SQL

OR

- GCP + Java + SQL

NP : Immediate to 35 Days max

Job Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida

- Bachelor's degree in computer science or a related discipline

- 6+ years of applicable engineering experience

- Experience in GCP, Big Query

- Strong proficiency in Python with an emphasis in building data pipelines

- Ability to write complex SQL to perform common types of analysis and aggregations

- Experience with Apache Airflow or Google Composer

- Detail-oriented and document all the work

- Ability to work with others from diverse skill-sets and backgrounds

- GCP solution architect - certified

Responsibilities :

- Design, develop, and deploy scalable and reliable data pipelines on Google Cloud Platform using services such as Cloud Dataflow, Apache Beam, or Apache Spark on Dataproc.

- Work closely with data scientists and analysts to understand data requirements and implement solutions that enable efficient data processing, analysis, and visualization.

- Build and maintain data ingestion processes from various sources (e.g. databases, APIs, streaming data) into GCP data storage solutions like BigQuery, Cloud Storage, and Cloud SQL.

- Optimize and tune data pipelines for performance, scalability, and cost-effectiveness.

- Implement data security and compliance measures to ensure data integrity and privacy.

- Collaborate with cross-functional teams to support data-driven decision-making and business intelligence initiatives.

- Stay updated with the latest trends and best practices in data engineering and GCP services.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Proven experience as a data engineer with a focus on designing and building data pipelines and analytics solutions.

- Hands-on experience with Google Cloud Platform services, particularly BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.

- Proficiency in programming languages such as Python, Java, or Scala for data processing and pipeline development.

- Strong understanding of data modeling, database design principles, and SQL.

- Experience with workflow orchestration tools like Apache Airflow or Google Cloud Composer.

- Familiarity with DevOps practices and tools for CI/CD, version control, and infrastructure as code.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

(ref:hirist.tech)

  • Manager- Data center operations

    5 days ago

    kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • Manager- Data center operations

    5 days ago

    Kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Data Engineer

    6 days ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS CloudJob Type: Full-TimeLocation: KolkataExperience: - 5+ to 10+ YearsMust Have: Aws-Data-Services, AWS Cloud, Data engineer.Key ResponsibilitiesAWS AuroraAWS RDSAWS Dynamo DBAWS S3AWS LambdaAWS GlueAWS Step FunctionsAWS Event BridgeAWS DMSAWS SCTData MigrationPythonPySparkSQLEducation:B. Tech or equivalent IT Degree.

  • Data Engineer

    6 days ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS Cloud Job Type: Full-TimeLocation: KolkataExperience: - 5+ to 10+ YearsMust Have: Aws-Data-Services, AWS Cloud, Data engineer.Key ResponsibilitiesAWS AuroraAWS RDSAWS Dynamo DBAWS S3AWS LambdaAWS GlueAWS Step FunctionsAWS Event BridgeAWS DMSAWS SCTData MigrationPythonPySparkSQLEducation: B. Tech or equivalent IT Degree.

  • Data Engineer

    6 days ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS Cloud Job Type: Full-Time Location: Kolkata Experience: - 5+ to 10+ Years Must Have: Aws-Data-Services, AWS Cloud, Data engineer. Key Responsibilities AWS Aurora AWS RDS AWS Dynamo DB AWS S3 AWS Lambda AWS Glue AWS Step Functions AWS Event Bridge AWS DMS AWS SCT Data Migration Python PySpark SQL ...

  • Data Engineer

    5 days ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS Cloud Job Type: Full-TimeLocation: KolkataExperience: - 5+ to 10+ YearsMust Have: Aws-Data-Services, AWS Cloud, Data engineer.Key ResponsibilitiesAWS AuroraAWS RDSAWS Dynamo DBAWS S3AWS LambdaAWS GlueAWS Step FunctionsAWS Event BridgeAWS DMSAWS SCTData MigrationPythonPySparkSQLEducation: B. Tech or equivalent IT Degree.

  • Data Engineer

    2 days ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data Engineer Location: Hyderabad / Chennai / Pune / Mumbai / Bangalore / Kolkata Experience: 8 - 16 Years only Must have minimum of 6 Years of Database Experience with Azure cloud experience Must have Data Mesh Data products implementation experience Must have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Data Engineer

    2 weeks ago

    kolkata, India HTD Resources Full time

    Skill: Data Engineer with Python knowledge Designation : Software Engineer Relevant Experience: 5 - 6 years Mandatory Skills: Primary Skills - Python, SQL, AWS, DWH Concept, ELT, Secondary Skills - GCP, CDC Location: Mumbai / Kolkata Mode: Work from Office Interview Rounds: 3-4 Rounds

  • Senior Data Engineer

    1 month ago

    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineeringPrimary responsibilities would include:Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • Software Engineer-Data Engineer

    1 month ago

    Kolkata, India CliniSys Full time

    Essential FunctionsExtract data from on-prem databases using appropriate tools and techniques.Transform and clean the data to ensure its suitability for PowerBI analysis.Build and maintain data pipelines for regular data refresh in PowerBI.Monitor and maintain Azure Synapse pipelines for on-prem data extraction and transformation.Collaborate with analysts to...

  • Senior Engineer

    3 days ago

    Kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our...

  • Senior Engineer

    1 day ago

    kolkata, India NTT DATA Full time

    Job Description NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. In today’s ‘iNTTerconnected’ world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help...

  • Senior Data Engineer

    1 month ago

    kolkata, India FinArb Consulting Full time

    Responsibilities We are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering   Primary responsibilities would include:     Investigate source data systems to build comprehensive data models to serve as Single Source of Truth Design and implement flexible, robust & scalable ETL...

  • Senior Data Engineer

    1 month ago

    Kolkata, India FinArb Consulting Full time

    ResponsibilitiesWe are looking for a for a strong self-driven Senior Data Engineer to join the team of data and software ­­­engineering Primary responsibilities would include:   Investigate source data systems to build comprehensive data models to serve as Single Source of TruthDesign and implement flexible, robust & scalable ETL infrastructureDeploy...

  • ▷ Apply Now: Data Engineer

    5 days ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Data engineer with AWS CloudJob Type: Full-TimeLocation: KolkataExperience: - 5+ to 10+ YearsMust Have: Aws-Data-Services, AWS Cloud, Data engineer.Key Responsibilities- AWS Aurora- AWS RDS- AWS Dynamo DB- AWS S3- AWS Lambda- AWS Glue- AWS Step Functions- AWS Event Bridge- AWS DMS- AWS SCT- Data Migration- Python- PySpark- SQLEducation:- B....

  • Hiring For Data Engineer- Databricks Azure Data Factory Python

    3 weeks ago

    Kolkata, West Bengal, India timesjobs Full time

    Hiring For Data Engineer- Databricks Azure Data Factory Python Job Description Data Engineer- Databricks Azure Data Factory Python Desired Profile Skills: Azure Databricks Azure Data Factory Python, implementing both structured and unstructured data, Data migration solutions, Data Warehousing, Data processing / ETL / Big data, Hadoop, Java, Spark, Scala, and...

  • Hiring For Data Engineer- Databricks Azure Data Factory Python

    3 weeks ago

    Kolkata, India timesjobs Full time

    Hiring For Data Engineer- Databricks Azure Data Factory Python Job Description Data Engineer- Databricks Azure Data Factory Python Desired Profile Skills: Azure Databricks Azure Data Factory Python, implementing both structured and unstructured data, Data migration solutions, Data Warehousing, Data processing / ETL / Big data, Hadoop, Java, Spark,...

  • Azure Data Engineer

    3 weeks ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Azure Data Engineer

    3 weeks ago

    Kolkata, India LTIMindtree Full time

    Position: Azure Data EngineerLocation: Hyderabad / Chennai / Pune / Mumbai / Bangalore / KolkataExperience: 8 - 16 Years onlyMust have minimum of 6 Years of Database Experience with Azure cloud experienceMust have Data Mesh Data products implementation experienceMust have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Lead Consultant-Data Bricks Engineer

    4 days ago

    Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...