Data Engineer

1 month ago

Kolkata, India SMARTWORK IT SERVICES Full time

Job Title : Senior Data Engineering Manager GCP.

Experience Required : 14-16 years (Level 5 Senior Manager).

Location : Bangalore, Chennai, Kolkata, Gurugram, Pune.

Mandatory Skills : GCP, GCS, BigQuery, SQL, Data Flow, DataProc with PySpark, Pub/Sub, Airflow, Python, Spark.

Job Description :


We are looking for an analytical, big-picture thinker who is driven to enhance and further the mission of client by delivering technology to internal business and functional stakeholders. You will serve as a leader to drive the IT strategy to create value across the organization.

As a Data Engineer, you will lead the engagement to focus on implementing both low-level, innovative solutions, as well as the day-to-day tactics that drive efficiency, effectiveness, and value.

You will play a critical role in creating and analyzing deliverables to provide critical content for fact-based decision-making, facilitation, and achievement of successful collaboration with business stakeholders.

You will analyze, design, and develop best practices for business changes through technology solutions.

Technical Requirements :


- Have implemented and architected solutions on Google Cloud Platform using GCP components.


- Experience with Apache Beam/Google Dataflow/Apache Spark in creating end-to-end data pipelines.


- Experience in some of the following : Python, Hadoop, Spark, SQL, BigQuery, BigTable, Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning.

- Experience programming in Java, Python, etc.

- Expertise in at least two of these technologies: Relational Databases, Analytical Databases, NoSQL databases.

- Certified Google Professional Data Engineer or Solution Architect is a major advantage.

Roles & Responsibilities :


- Experience : 14-16 years in IT or professional services in IT delivery or large-scale IT analytics projects.

- Expert knowledge of Google Cloud Platform; experience with other cloud platforms is a plus.

- Expert in SQL development.

- Expertise in building data integration and preparation tools using cloud technologies (like Snaplogic, Google Dataflow, Cloud Dataprep, Python, etc.

- Experience with Apache Beam/Google Dataflow/Apache Spark in creating end-to-end data pipelines.

- Experience in Python, Hadoop, Spark, SQL, BigQuery, BigTable, Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning.

- Ability to identify downstream implications of data loads/migration (e., data quality, regulatory, etc.

- Implement data pipelines to automate data source ingestion, transformation, and augmentation, and provide best practices for pipeline operations.

- Capable of working in a rapidly changing business environment and enabling simplified user access to massive data by building scalable data solutions.

- Advanced SQL writing and experience in data mining (SQL, ETL, data warehousing, etc.) and using databases in a business environment with complex datasets.

(ref:hirist.tech)

  • Senior Data Integration Engineer

    2 weeks ago

    Kolkata, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Networking Managed Services Engineer-L2

    1 month ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Network Security Engineer

    1 month ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Team Lead

    1 month ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • MS Engineer, Unix

    1 month ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    2 months ago

    Kolkata, India Dautom Full time

    Role: Data Support Engineer Client: One of the leading banks in the UAEJob Location: Offshore (anywhere in India)Contract Duration: Minimum 6 months extendable contract (based on job performance and business needs)Technical Skills:Bachelor’s Degree in Computer Science, Information Technology, Data Science, Software Engineering, or a related field.5 to 10...

  • Data engineer

    3 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    3 days ago

    Kolkata, India s seth's assignment's Full time

    Job Title: Data EngineerLocation: Remote Contract Terms: 3 Months with the potential to extend for more than a yearOverviewWe are looking for a highly skilled and motivated Data Engineer with 4-8 years of experience to join our dynamic team. This role is ideal for individuals with advanced technical expertise in Python programming and relational databases,...

  • Highly Skilled Cybersecurity Solutions Engineer

    2 weeks ago

    Kolkata, West Bengal, India NTT DATA Full time

    About the JobWe are seeking a highly skilled and experienced Cybersecurity Solutions Engineer to join our team at NTT DATA.Job DescriptionThe primary objective of this role is to ensure zero missed service level agreement (SLA) conditions and provide expert-level technical support to clients. The successful candidate will be responsible for managing tickets...

  • Data Engineer

    4 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    3 months ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    3 months ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • Data Engineer

    4 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • Data Engineer

    4 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    3 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data Engineer

    2 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data engineer

    3 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; Py Spark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data Engineer

    4 weeks ago

    kolkata, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database Engineer Experience Required: 3-15 Years Location: Kolkata Job Type: Full-time Must Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step Function Key Responsibilities: - Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB. - Build and maintain scalable ETL pipelines...

  • Data engineer

    3 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, Dynamo DB, Python, Py Spark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...

  • Data Engineer

    7 days ago

    Kolkata, West Bengal, India FinArb Consulting Full time

    Job TitleSenior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at FinArb Consulting. This is an exciting opportunity to work on large-scale data engineering projects, leveraging modern technologies to drive impactful insights.Key ResponsibilitiesDesign and build scalable data pipelines and workflows using...