Data Engineer
3 months ago
Job Position: Azure Cloud DB Engineer
Job Type: Full-Time
Location: Kolkata, IN
Experience: - 3 to 8+ Years
Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python
Responsibilities:
Data Pipeline Development:
- Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from various sources.
- Develop and manage ETL processes to ensure data quality and integrity across platforms.
Database Management:
- Deploy and maintain Azure SQL Databases and Azure Cosmos DB, ensuring optimal performance and reliability.
- Monitor and troubleshoot database performance issues, applying best practices for tuning and scaling.
Data Engineering:
- Utilize Azure Databricks for big data processing, leveraging PySpark to analyze and transform large datasets.
- Develop and maintain data models and architecture that support analytics and reporting needs.
Programming and Scripting:
- Write efficient Python scripts to automate data processing tasks and enhance data workflows.
- Create reusable code libraries and documentation to streamline data operations and facilitate collaboration.
Collaboration and Support:
- Work closely with data analysts, data scientists, and application developers to support data-driven projects.
- Provide technical support for database-related issues and assist in troubleshooting data pipeline failures.
Best Practices and Security:
- Implement data governance and security policies to ensure compliance with industry standards.
- Stay up-to-date with emerging technologies and best practices in cloud database management and data engineering.
Qualifications:
Bachelor’s degree in Computer Science, Information Technology, or a related field.
-
Data engineer
2 months ago
Kolkata, India Webologix Ltd INC Full timeJob Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...
-
Data Engineer
4 weeks ago
Kolkata, India s seth's assignment's Full timeJob Title: Data EngineerLocation: Remote Contract Terms: 3 Months with the potential to extend for more than a yearOverviewWe are looking for a highly skilled and motivated Data Engineer with 4-8 years of experience to join our dynamic team. This role is ideal for individuals with advanced technical expertise in Python programming and relational databases,...
-
Data Engineer
3 weeks ago
Kolkata, India Gemraj Technologies Ltd Full timeData EngineerPosition: FTE, remote, IndiaAvailability-Immediate-1 weekOverlap: 4 hours with PST(Pacific Standard Time)Candidate proficiency level: Senior(8+)Responsibilities:Design, build and maintain core data infrastructure pieces that allow Aircall to support our many data use cases.Enhance the data stack, lineage monitoring and alerting to prevent...
-
Data Engineer
4 months ago
Kolkata, India Webologix Ltd INC Full timeJob Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...
-
Data Engineer
4 months ago
Kolkata, India Webologix Ltd INC Full timeJob Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...
-
Data Engineer
4 months ago
Kolkata, India Webologix Ltd INC Full timeJob Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities: Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...
-
Data Engineer
1 month ago
Kolkata, India Webologix Ltd INC Full timeJob Position: AWS Cloud DB Engineer Job Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...
-
Data Engineer
2 months ago
Kolkata, India Webologix Ltd INC Full timeJob Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...
-
Data engineer
2 months ago
Kolkata, India Webologix Ltd INC Full timeJob Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; Py Spark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...
-
Data engineer
2 months ago
Kolkata, India Webologix Ltd INC Full timeJob Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, Dynamo DB, Python, Py Spark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...
-
Data Engineer
4 weeks ago
Kolkata, West Bengal, India FinArb Consulting Full timeJob TitleSenior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at FinArb Consulting. This is an exciting opportunity to work on large-scale data engineering projects, leveraging modern technologies to drive impactful insights.Key ResponsibilitiesDesign and build scalable data pipelines and workflows using...
-
Senior Data Engineer
4 weeks ago
Kolkata, India eInfochips (An Arrow Company) Full timeRole: Senior Data EngineerYears of Experience: 5-10Location: Ahmedabad Overview:We are seeking a highly skilled and experienced Senior Software Engineer to join our Data Engineering team. The ideal candidate will have 5 to 10 years of experience in software engineering, with a strong focus on data engineering practices and an awareness of AI/ML and...
-
Senior Data Engineer
2 months ago
Kolkata, India FinArb Consulting Full timeJob Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...
-
Senior Data Engineer
2 months ago
kolkata, India FinArb Consulting Full timeJob Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...
-
Azure Data Engineer
4 months ago
Kolkata, India Talpro Full timeJob Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....
-
Data Engineer
2 months ago
Kolkata, India Webologix Ltd INC Full timeJob Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: -Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL processes...
-
Data Engineer
4 months ago
Kolkata, India Webologix Ltd INC Full timeJob Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities:Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...
-
Data Engineering Specialist
3 weeks ago
Kolkata, West Bengal, India 2Coms Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at 2Coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines using tools like PySpark, Spark Scala, or Databricks.
-
Gcp data engineer
2 days ago
Kolkata, India Global Infovision Private Limited Full timeJob Title: GCP Data EngineerJob Location: Indore, Nagpur, Bhubaneswar & KolkataJob Type: Full-TimeClient: DirectExperience:7 years of experience in data engineering, with a focus on cloud-based solutions.Extensive experience with Google Cloud Platform (GCP) and its data services, including Big Query, Dataflow, Pub/Sub, Cloud Storage, and Cloud...
-
GCP Data Engineer
2 weeks ago
Kolkata, India Global Infovision Private Limited Full timeJob Title: GCP Data EngineerJob Location: Indore, Nagpur, Bhubaneswar & KolkataJob Type: Full-TimeClient: DirectExperience:7 years of experience in data engineering, with a focus on cloud-based solutions.Extensive experience with Google Cloud Platform (GCP) and its data services, including Big Query, Dataflow, Pub/Sub, Cloud Storage, and Cloud...