Data Engineer

1 month ago


MumbaiKolkata, IN Ultimate Digital Solutions Pvt. Ltd. Full time

We're searching for a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in Python, AWS Glue, SQL, and data pipeline development. You'll be instrumental in designing, building, and maintaining robust data architectures and pipelines, ensuring high-quality data for analysis and insights.


Location : Kolkata or Mumbai


Experience :


- 6-8 years of overall experience


- At least 5+ years of hands-on experience with Python


Key Responsibilities :


- Design and implement efficient data pipelines using Python, AWS Glue, and other relevant tools.


- Leverage AWS Glue to build and manage ETL (Extract, Transform, Load) processes and integrate data from various sources.


- Work with databases to store, manage, and query data using SQL.


- Design and implement scalable data models and architectures to support business needs.


- Analyze and optimize data pipelines and queries for performance and efficiency.


- Collaborate with data analysts, scientists, and other stakeholders to understand requirements and provide data-driven insights.


Must-Have Skills/Competencies :


- Proficiency in AWS DWH tech stack with Python


- Ability to create reusable base classes using AWS libraries


- Strong understanding of SOLID principles and DWH fundamentals


- Experience with end-to-end data pipelines in PySpark and Athena


- Expertise in building end-to-end data pipelines using AWS Glue in Python with boto3


- Knowledge of scheduling glue jobs.


Soft Skills :


- Strong problem-solving skills and attention to detail


- Excellent communication skills to work effectively with cross-functional teams


- Ability to manage multiple projects and deadlines in a fast-paced environment

(ref:hirist.tech)
  • Azure Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations/Mumbai/Bangalore/Hyderabad/Kolkata/Chennai/Pune/Bhubaneshwar/Na, IN Talpro Full time

    Job Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....

  • Data Engineer

    1 month ago


    Hyderabad/Chennai/Bangalore/Delhi/Kolkata/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Title : GCP Data EngineerExperience : 6-8 YearsLocations : Hyderabad, Chennai, Bangalore, Pune, Mumbai,, Kolkata & DelhiNotice period: 15 DaysWork mode : Hybrid (2 Days work from office)Job type : FTE/C2HRole Description :We are seeking an experienced GCP Data Engineer with 6-8 years of experience to join our team. The ideal candidate will be responsible...

  • Data Engineer

    1 month ago


    Mumbai/Bangalore/Pune/Chennai/Hyderabad, IN Changeleaders Full time

    Company Overview :Tech Mahindra is a leading provider of digital transformation, consulting, and business re-engineering services and solutions. We leverage next-generation technologies to help our clients achieve their business objectives.Job Summary :We are looking for an experienced Azure Data Engineer to join our dynamic team. The ideal candidate will be...

  • BI Tableau Engineer

    4 weeks ago


    Bangalore/Hyderabad/Delhi/Kolkata, IN Freelance Full time

    Job DescriptionSenior resource with minimum 2-8 Years of experience in Tableau.- Very strong experience on Tableau Functions, Tableau Data Prep and Tableau Visuals.- Good experience on end-to-end Enterprise BI development & deployment.- Developing data Models, Data Preparation with Data Flows and designing BI reports- Proven experience in writing advanced...

  • Data Engineer

    4 weeks ago


    Chennai/Kolkata/Pune/Bangalore/Hyderabad, IN Risk Resources India Full time

    ETL- HadoopRole and Responsibilities :- Design Extract/Load/Transform (ETL) workflows to develop large scale data structures and pipelines to organize, collect and standardize data- Uses knowledge of Hadoop architecture, HDFS commands and experience in designing, optimizing queries to build data pipelines- Integrate data from a variety of sources, assuring...

  • Data Engineer

    6 months ago


    Mumbai/Bangalore/Hyderabad/Chennai/Pune/Delhi, IN VARITE Inc. Full time

    Job Title: Data EngineerLocation City : Hyderabad, bangalore, chennai, mumbai, new delhi, pune.Experience Required : 4+Shift: Day ShiftWork Mode: OnsitePosition Type: ContractOpenings: 3Company Name : VARITE INDIA PRIVATE LIMITEDAbout The Client: A multinational technology and e-commerce company based in the United States is widely recognized as one of the...


  • Hyderabad/Bangalore/Mumbai/Kolkata, IN TeamWare Solutions Full time

    We are looking for actuarial data analysts to join our team to deliver a strategic project for a leading insurance client. The skillset required is actuarial resources with an understanding of the data and Python. We are not looking for modeling actuaries to work on actuarial models but are looking for actuarial data analysts.Skills and responsibilities :-...


  • Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, IN AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Position - Senior Big Data Engineer (GCP)Experience - 5 to 8 YrsLocation - RemoteShift - EST Shift 5:30 PM to 2:30 AMWe are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful candidate will be...

  • Data Engineer II

    1 month ago


    Bangalore/Pune/Mumbai/Coimbatore/Delhi NCR/Delhi/Navi Mumbai, IN Concept Management Full time

    Role - Data Engineer 2Job Type - Full-time, Permanent Qualification - BE or BtechNumber Of Roles - 15Location - Bangalore, Pune, Mumbai, Delhi, Gurugram, CoimbatorePackage - 15 to 20 LPAExperience - 3.5 to 6 YearsShift - UK Shift15 to 30 Days JoinerSkills : Data Engineering, Big data, ETL, Python, PySpark and SparkSQ, SQL, JIRA, Git, and GitHub.Job Summery...


  • Navi Mumbai/Pune/Bangalore, IN Techno Wise Full time

    Job Summary : We are seeking a highly skilled and motivated individual to join our team as a Senior Azure Data Engineer. The ideal candidate will have a strong background in Azure data technologies, a proven track record of ability to design and implement scalable and efficient data solutions.Responsibilities :- Design, develop, and deploy data pipelines and...


  • Bangalore/Hyderabad/Mumbai/Kolkata, IN Teamware Solutions ( A division of Quantum Leap Co Full time

    Actuarial Data Analyst - IFRS & Python Specialist. Location : Hybrid; Bangalore, Hyderabad, Mumbai, Kolkata 2nd Shift 2-11 PM. Experience : 5 -12 Years. Notice Period : Immediate to 15 days. Role : Data AnalystJob Description :We are seeking a highly skilled Actuarial Data Analyst to join our team. The ideal candidate will have a strong understanding of IFRS...

  • Engagement Manager

    1 month ago


    Mumbai/Delhi NCR/Kolkata, IN Resource Tree Full time

    Job Description :As Program Lead - Technology Consulting, you will be key member of the teams working on end-to-end AI and analytics solutions being built for our clients. Exp : 6 -14 yrsLocation : your primary focus will be on the data engineering and application engineering components of the overall solution, you will collaborate with internal data science...

  • Senior Data Engineer

    1 month ago


    Chennai/Bangalore/Pune/Hyderabad/Kolkata/Noida/Mumbai/Gurgaon/Gurugram/Jaipur/Delhi NCR, IN Zenfinet Solutions Private Limited Full time

    Chennai, Bangalore, Pune, Hyderabad, Kolkata, Noida, Mumbai, Gurgaon, Jaipur, New Delhi (Any of these Locations based on candidate's Choice)Notice period : 0- 30 days (Strictly Serving Notice period must apply)Job Description :- Design, build, and maintain robust and scalable data pipelines using AWS services like S3, Glue, EMR, and Redshift.- Develop...

  • Azure Data Engineer

    1 month ago


    Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, IN VIDPRO CONSULTANCY SERVICES Full time

    Skills and Qualifications :- Bachelor's and/or master's degree in computer science or equivalent experience.- Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.- Expertise in Snowflake security, Snowflake SQL and designing/implementing other Snowflake objects.- Hands-on experience with Snowflake...


  • Mumbai/Bangalore/Trivandrum/Thiruvananthapuram, IN Quantiphi Analytics Full time

    Role : Senior Data EngineerExperience Range : 3-7 Years Work Location : Mumbai/ Bangalore/ Trivandrum (Hybrid)Responsibilities :- Design and Implement Data Pipelines : Develop and maintain scalable data pipelines to extract, transform, and load data from various sources into data warehouses or lakes, ensuring high data quality and integrity.- Amazon...


  • Bangalore/Gurgaon/Gurugram/Kolkata/Pune/Chennai, IN VIDPRO CONSULTANCY SERVICES Full time

    Roles and responsibilities :- Solution Architect for Data modelling - Understanding of Enterprise datasets - Sales, Procurement, Finance, Supply Chain, Logistics, R&D, Advanced Planning systems (SAP/Oracle etc); Have worked for minimum 5 years for Data projects ( Upgradation, Migration, Building Data lake foundation, Maintenance etc)- Collaborate with the...

  • Scala/Spark Developer

    1 month ago


    Mumbai/Pune/Bangalore, IN Xoriant Solutions Full time

    We are eagerly seeking candidates with 5 to 9 years' experience for a Spark & Scala Developer to join our dynamic team. The ideal candidate will play a pivotal role for our business in delivering data and insights to our clients. We're driving the company's digital transformation and expanding business capabilities using industry best practices...


  • Pune/Mumbai/Hyderabad, IN HyrEzy Talent Solutions Full time

    JOB TITLE : Principal Salesforce Engineer (Data : Pune/ Mumbai / HyderabadExperience : 7+ yrs.SHIFT TIME : General Shift (9:30 to 6:30)NOTICE PERIOD : 30 daysINTERVIEW ROUNDS : 4 roundsMODE OF INTERVIEW : VirtualMust-Have Skills : Salesforce Experience with Data migration is Background : BA/BS degree in Computer Science, Engineering, or a related field, with...

  • Azure Data Engineer

    1 month ago


    Gurgaon/Gurugram/Bangalore/Chennai/Pune/Mumbai, IN Element Infomatics Pvt. Ltd. Full time

    About the job :Company Description:Element Technologies Inc is a technology company based in Bangalore, committed to offering high-value IT services using flexible engagement and delivery models. We collaborate with global industry-leading technologies to deliver greater business value in sectors such as Life Sciences, Banking & Financial Services, Retail,...

  • Big Data Engineer

    1 month ago


    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, IN GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Description : Big Data Engineer - Scala, SparkYears of exp: 6 to 13 yearsJob location: Chennai / Hyderabad / Bangalore / Pune / Mumbai / Delhi / CoimbatoreAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be...