[15h Left] Data Engineer with Python

3 weeks ago


Delhi, India Unison Consulting Full time
- Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform- Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale- Optimize and troubleshoot AWS Glue jobs for performance and reliability- Utilize Python and PySpark to efficiently handle large volumes of data during the ingestion process- Design and implement scalable data processing solutions using PySpark to transform raw data into a structured and usable format- Apply data cleansing, enrichment, and validation techniques to ensure data quality and accuracy- Create and maintain ETL processes using Python and PySpark to move and transform data between different systems- Optimize ETL workflows for performance and efficiency- Collaborate with data architects to design and implement data models that support business requirements- Ensure data structures are optimized for analytics and reporting- Work with distributed computing frameworks, such as Apache Spark, to process and analyze large-scale datasets- Manage and optimize databases, both SQL and NoSQL, to support data storage and retrieval needs- Implement indexing, partitioning, and other database optimization techniques- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions- Work closely with software engineers to integrate data solutions into larger applications- Implement monitoring solutions to track data pipeline performance and proactively identify and address issues- Ensure compliance with data privacy regulations and company policies- Stay abreast of industry trends and advancements in data engineering, Python, and PySpark

Requirements

- Proficiency in Python and PySpark- Strong knowledge of data engineering concepts and best practices- Hands-on experience with AWS Glue and other AWS services- Experience with big data technologies and distributed computing- Familiarity with database management systems (SQL and NoSQL)- Understanding of ETL processes and data modeling- Excellent problem-solving and analytical skills- Strong communication and collaboration skills- Bachelor's degree in Computer Science, Information Technology, or a related field
  • Python Developer

    1 month ago


    Delhi, India Revature Full time

    Job Title: Associate Python DeveloperPosition Type: Full-timeExperience: 1.5-7 years in Python developmentAbout Us:We are seeking a motivated and talented Associate Python Developer to join our growing team and contribute to the development of our software products.Responsibilities:Python:1. Secure Data Exchange: Proficiency in implementing token-based...


  • Delhi, India NielsenIQ Full time

    Manager Data EngineeringOur #NielsenIQ technology teams are working on building a unified, global, open data ecosystem powered by Microsoft Azure & Snowflake. Our clients around the world rely on #NielsenIQ data and insights to innovate and grow. We are looking for an experienced Cloud Datawarehouse leader to be part of our Technology hub in Chennai, to...


  • Delhi, India Gemraj Technologies Ltd Full time

    The ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract valuable insights from highly complex data sets to ask the right questions and find the right answers.Responsibilities- Write effective Python code to tackle complex issues, but also use your business sense...


  • Delhi, India Chryselys Full time

    Job Description:As a Data Engineering Lead, you will play a critical role in driving the delivery for our clients data projects. Leveraging your expertise in data engineering and data operations, you will work closely with clients to ensure that the project delivery on time with quality and meeting the requirements. This role requires a deep understanding of...


  • Delhi, India Mphasis Full time

    This opportunity is for Banglore, Hyderabad, and Pune locations and it's work from office.About the Role:We are seeking a proficient ETL developer with expertise in GCP to join our team. The ideal candidate will have a strong background in designing and implementing data pipelines, particularly on cloud platforms, with a preference for Google Cloud...

  • Data Scientist

    4 weeks ago


    Delhi, India Valiance Solutions Full time

    About Us: Valiance Solutions is a leading AI consulting firm specializing in delivering cutting-edge data science solutions. With expertise in AI, data engineering, and cloud platforms, we help our clients solve complex business problems. We are seeking a talented Data Scientist with expertise in Azure Cloud to join our dynamic team.Job Summary: Valiance...


  • Delhi, India ValueLabs Full time

    Greetings from ValueLabs!ValueLabs is hiring for Azure ML Engineer.Experience: 5-8 yearsLocation: HyderabadNotice Period: Immediate Joiners (Only)Mode of work: HybridPrimary Skills: Machine Learning, Python, MLOps & Automation, Azure Ecosystem, Azure DevopsJob Description:- Machine Learning & AI: Advanced ML algorithms, Azure ML, deep learning (TensorFlow,...

  • Data Engineer

    4 weeks ago


    New Delhi, India Uplers Full time

    Uplers - Uplers, originated as an outsourcing firm in 2012, evolved to offer innovative solutions beyond expertise.Uplers is a pioneering talent matchmaking platform that bridges the gap between global companies and top-tier Indian professionals, redefining remote hiring through robust technical skill assessments tailored to specific roles. Uplers seamlessly...

  • Operations Specialist

    3 weeks ago


    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    4 weeks ago


    Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Data Engineer

    2 months ago


    Delhi, India Unison Consulting Pte Ltd Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases.At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer...

  • Data Engineer

    3 weeks ago


    Delhi, India Unison Consulting Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related fieldAt least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databasesAt least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer...

  • Data Engineer

    2 weeks ago


    Delhi, India Unison Consulting Pte Ltd Full time

    Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases.At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer...


  • delhi, India Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd Full time

    Greetings from Teamware Solutions. . !!Join Our Team. .. #MNC HiringWe are hiring GCP Data Engineering with Python. . !!Job Title: GCP Data Engineering with PythonJob Type: Full-Time (Hybrid)Job Location: Hyderabad/Bangalore/Mumbai/KolkataExperience: 4+ YearsNotice Period: Immediate to 15 daysJob Description:solid experience in Data Flow.should have worked...


  • Delhi, India Unison Consulting Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platformDevelop and maintain ETL jobs using AWS Glue services to process and transform data at scaleOptimize and troubleshoot AWS Glue jobs for performance and reliabilityUtilize Python and PySpark to efficiently handle large volumes of data...


  • Delhi, India Unison Consulting Pte Ltd Full time

    Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform.Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale.Optimize and troubleshoot AWS Glue jobs for performance and reliability.Utilize Python and PySpark to efficiently handle large volumes of data...

  • Lead ELK Data Analyst

    1 month ago


    Delhi, India AQUASoft Full time

    AQUASoft is a software development company that specializes in creating custom-made products and software solutions for various clients, including Fortune 500 giants and medium-sized businesses. Our team of highly skilled and experienced software engineers across two continents utilize the latest frameworks and state-of-the-art technologies to build robust,...


  • Delhi, India Performics Full time

    Responsibilities:- Data Pipeline Development: Design, build, and maintain data pipelines for collecting and processing marketing data.- Data Integration: Ensure seamless integration of data from various sources, including marketing platforms and databases.- Data Warehousing: Manage and optimize data warehousing solutions for efficient data storage and...


  • Delhi, India Nityo Infotech Full time

    16 hours ago **Job Code**: JD-19728 **JOB DESCRIPTION**: Job Title: Sr. Software Engineer - Python We are looking forward to hire Python Professionals in the following areas : Experience - 4-6 Years Job description - We are looking for a Python Developer to join our engineering team and help us develop and maintain various software products. - The...