Data Engineer

4 months ago


Kolkata, India Webologix Ltd INC Full time

Job Position: Azure Cloud DB Engineer

Job Type: Full-Time

Location: Kolkata, IN

Experience: - 3 to 8+ Years

Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python


Responsibilities:

Data Pipeline Development:

  • Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from various sources.
  • Develop and manage ETL processes to ensure data quality and integrity across platforms.

Database Management:

  • Deploy and maintain Azure SQL Databases and Azure Cosmos DB, ensuring optimal performance and reliability.
  • Monitor and troubleshoot database performance issues, applying best practices for tuning and scaling.

Data Engineering:

  • Utilize Azure Databricks for big data processing, leveraging PySpark to analyze and transform large datasets.
  • Develop and maintain data models and architecture that support analytics and reporting needs.

Programming and Scripting:

  • Write efficient Python scripts to automate data processing tasks and enhance data workflows.
  • Create reusable code libraries and documentation to streamline data operations and facilitate collaboration.

Collaboration and Support:

  • Work closely with data analysts, data scientists, and application developers to support data-driven projects.
  • Provide technical support for database-related issues and assist in troubleshooting data pipeline failures.

Best Practices and Security:

  • Implement data governance and security policies to ensure compliance with industry standards.
  • Stay up-to-date with emerging technologies and best practices in cloud database management and data engineering.


Qualifications:

Bachelor’s degree in Computer Science, Information Technology, or a related field.


  • Data engineer

    2 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    4 weeks ago


    Kolkata, India s seth's assignment's Full time

    Job Title: Data EngineerLocation: Remote Contract Terms: 3 Months with the potential to extend for more than a yearOverviewWe are looking for a highly skilled and motivated Data Engineer with 4-8 years of experience to join our dynamic team. This role is ideal for individuals with advanced technical expertise in Python programming and relational databases,...

  • Data Engineer

    3 weeks ago


    Kolkata, India Gemraj Technologies Ltd Full time

    Data EngineerPosition: FTE, remote, IndiaAvailability-Immediate-1 weekOverlap: 4 hours with PST(Pacific Standard Time)Candidate proficiency level: Senior(8+)Responsibilities:Design, build and maintain core data infrastructure pieces that allow Aircall to support our many data use cases.Enhance the data stack, lineage monitoring and alerting to prevent...

  • Data Engineer

    4 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    3 months ago


    kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    4 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • Data Engineer

    1 month ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data Engineer

    2 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data engineer

    2 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; Py Spark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data engineer

    2 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, Dynamo DB, Python, Py Spark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...

  • Data Engineer

    4 weeks ago


    Kolkata, West Bengal, India FinArb Consulting Full time

    Job TitleSenior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at FinArb Consulting. This is an exciting opportunity to work on large-scale data engineering projects, leveraging modern technologies to drive impactful insights.Key ResponsibilitiesDesign and build scalable data pipelines and workflows using...

  • Senior Data Engineer

    4 weeks ago


    Kolkata, India eInfochips (An Arrow Company) Full time

    Role: Senior Data EngineerYears of Experience: 5-10Location: Ahmedabad Overview:We are seeking a highly skilled and experienced Senior Software Engineer to join our Data Engineering team. The ideal candidate will have 5 to 10 years of experience in software engineering, with a strong focus on data engineering practices and an awareness of AI/ML and...

  • Senior Data Engineer

    2 months ago


    kolkata, India FinArb Consulting Full time

    Job Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • Senior Data Engineer

    2 months ago


    Kolkata, India FinArb Consulting Full time

    Job Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • Azure Data Engineer

    4 months ago


    Kolkata, India Talpro Full time

    Job Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....

  • Data Engineer

    2 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: -Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL processes...

  • Data Engineer

    4 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities:Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...


  • Kolkata, West Bengal, India 2Coms Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at 2Coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines using tools like PySpark, Spark Scala, or Databricks.

  • Gcp data engineer

    2 days ago


    Kolkata, India Global Infovision Private Limited Full time

    Job Title: GCP Data EngineerJob Location: Indore, Nagpur, Bhubaneswar & KolkataJob Type: Full-TimeClient: DirectExperience:7 years of experience in data engineering, with a focus on cloud-based solutions.Extensive experience with Google Cloud Platform (GCP) and its data services, including Big Query, Dataflow, Pub/Sub, Cloud Storage, and Cloud...

  • GCP Data Engineer

    2 weeks ago


    Kolkata, India Global Infovision Private Limited Full time

    Job Title: GCP Data EngineerJob Location: Indore, Nagpur, Bhubaneswar & KolkataJob Type: Full-TimeClient: DirectExperience:7 years of experience in data engineering, with a focus on cloud-based solutions.Extensive experience with Google Cloud Platform (GCP) and its data services, including Big Query, Dataflow, Pub/Sub, Cloud Storage, and Cloud...