Data Engineer

2 weeks ago


Kolkata, India ApplyT Full time

About us :


We are a Top MNC - Energizing the Educational Landscape


Must-Have Skills/Competencies :


- AWS DWH tech stack with python


- Create a solution in Python for creating reusable base classes using AWS libraries


- SOLID principles, DWH fundamentals with implementation


- End to end data pipelines in Pyspark & Athena


- End to end data pipelines using AWS Glue in Python using boto3


- Knowledge of Scheduling glue jobs


Roles and Responsibilities :


Design and Develop Data Pipelines : Lead the design and development of end-to-end data pipelines using AWS Glue, PySpark, and Athena, ensuring seamless data flow and integration.


Implement DWH Solutions : Apply your expertise in Data Warehouse (DWH) fundamentals to build and optimize DWH solutions on AWS, leveraging Python and AWS libraries.


Reusable Python Solutions : Create scalable and reusable Python base classes using AWS libraries, adhering to SOLID principles to enhance code maintainability and efficiency.


AWS Glue Job Management : Manage and schedule AWS Glue jobs using Python (boto3), ensuring that data processes run smoothly and on schedule.


Data Integration and Transformation : Oversee data integration and transformation processes, ensuring data accuracy, consistency, and availability across the and Problem Solving : Work closely with cross-functional teams to understand business requirements, troubleshoot issues, and provide effective data solutions.


Optimize Performance : Continuously monitor and optimize data pipelines for performance, reliability, and scalability within the AWS and Best Practices : Maintain thorough documentation of data pipelines, processes, and best practices, ensuring clarity and continuity for future and Knowledge Sharing : Mentor junior team members and actively contribute to knowledge-sharing initiatives within the team to foster a collaborative learning and Security: Ensure that all data processes and solutions comply with security, privacy, and regulatory standards, maintaining the integrity of sensitive information.

(ref:hirist.tech)

  • Kolkata, India Glacier Engineer Full time

    **Responsibilities**: - Manage and maintain records and data in an organized and efficient manner - Process paperwork and documentation accurately and in a timely manner - Assist with scheduling appointments and managing calendars - Coordinate with other departments to ensure timely completion of tasks and projects - Perform general office duties such as...

  • Data Engineer

    4 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    4 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    4 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • MS Engineer, Unix

    3 months ago


    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    4 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities:Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    6 days ago


    Kolkata, India Randstad India Full time

    Job Title - Pyspark DeveloperLocation - Hyderabad, Bangalore, ChennaiExperience - 4 - 8 YearsLooking for Immediate joiners or np with 15 days onlyAs a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring...


  • Kolkata, India IBM India Pvt Ltd Full time

    Apply for Data Engineer Data Platforms Google, Career Progress Consultants in Kolkata for 2 - 7 Year of Experience on TimesJobs.com.

  • Data Engineer

    2 weeks ago


    Kolkata, India Bizaccenknnect Full time

    Job Title : Data EngineerJob Description :As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines, as well as developing visualizations and reports to enable data-driven decision-making. The ideal candidate will have expertise in Tableau, SQL, Python, and Power BI, along with a strong background in data...

  • Data Engineer

    1 week ago


    Kolkata, India bizaccenknnect Full time

    Responsibilities : - Design, build, and optimize data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse.- Develop and maintain SQL scripts and queries for data manipulation, analysis, and reporting purposes.- Utilize Python for scripting, automation, and advanced data processing tasks.- Create interactive...

  • Big Data Engineer

    3 weeks ago


    Kolkata, India Anblicks Full time

    4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...

  • Data Engineer

    2 days ago


    Kolkata, India MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Title : GCP Data EngineerExperience : 6-8 YearsLocations : Hyderabad, Chennai, Bangalore, Pune, Mumbai,, Kolkata & DelhiNotice period: 15 DaysWork mode : Hybrid (2 Days work from office)Job type : FTE/C2HRole Description :We are seeking an experienced GCP Data Engineer with 6-8 years of experience to join our team. The ideal candidate will be responsible...


  • Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...


  • Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Azure Data Engineer

    1 month ago


    Kolkata, India People Prime Worldwide Full time

    AboutClient: Our client is globaltechnology consulting and digital solutions company that enablesenterprises to reimagine business models and accelerate innovationthrough digital technologies. Powered by more than 84000entrepreneurial professionals across more than 30 countries itcovers to over 700 clients. With its extensive domain andtechnology expertise...


  • Kolkata, India StatusNeo Technology Consulting Pvt. Ltd Full time

    Job Title : Data EngineerLocation : Kolkata, West Bengal, India (Work from office)Experience :- 3-5 years of experience in Information Technology industryRoles and Responsibilities :- Design, construct, install, test, and maintain scalable and stable data pipelines- Develop and implement data architecture and data modeling solutions- Optimize and improve...


  • Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...


  • Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...


  • Kolkata, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...


  • Kolkata, India LIN Lexmark Int'l India Pvt. Ltd. Full time

    Description /Responsibilities: The candidate will work in Global IT as a Senior Data Integration Engineer will be responsible for collaborating with global business users and other IT teams. The candidate is expected to understand key business objectives and IT delivery capabilities to provide fully integrated solutions in cloud Platform. The candidate...