Aws Data Engineer

2 days ago


Delhi, India ITI Data Full time
Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There is no requirement for Machine Learning skills. This is a high visibility, fast-paced key initiative will integrate data across internal and external sources, provide analytical insights, and integrate with the customer’s critical systems.Key Responsibilities-

Design, build and unit test applications on Spark framework on Python.-

Build Python and PySpark based applications based on data in both Relational databases (e.G. Oracle), NoSQL databases (e.G. DynamoDB, MongoDB) and filesystems (e.G. S3, HDFS)-

Build AWS Lambda functions on Python runtime leveraging pandas, json, boto3, requests, avro libraries-

Build PySpark based data pipeline jobs on AWS Glue ETL requiring in-depth knowledge on AWS Glue Dynamic Frames and Options-

Build Python based event-driven integration with Kafka Topics, leveraging Confluent Kafka libraries-

Design and Build Generic, Reusable utility applications in Python-

Build the Python programs across Glue ETL jobs and Lambda functions-

Optimize performance for data access requirements by choosing the appropriate native Hadoop file formats (Avro, Parquet, ORC etc) and compression codec respectively.-

Design & Build S3 buckets, tiers, lifecycle policies, as strategic storage layer for "Data Lake"-

Optimize performance of Spark applications in Hadoop using configurations around Spark Context, Spark-SQL, Data Frame, and Pair RDD's-

Setup the Glue crawlers in order to catalog OracleDB tables, MongoDB collections and S3 objects-

Configure Athena tables and SQL views based on Glue Cataloged datasets-

Ability to monitor, troubleshoot and debug failures using AWS CloudWatch and Datadog-

Ability to solve complex data-driven scenarios and triage towards defects and production issues-

Participate in code release and production deployment.
  • AWS Data Engineer

    4 weeks ago


    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Aws Data Engineer

    2 days ago


    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    7 days ago


    Delhi, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development:Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...

  • Data Engineer

    2 weeks ago


    new delhi, India CX Data Labs Full time

    Data EngineerAbout CX Data Labs: At CX Data Labs, we believe that by systematically understanding and adapting to changing customer preferences, companies can sustainably grow their business. We help our clients realize this vision through our advisory and implementation services in Digital, Data, and Analytics competencies, bridging the gap between...

  • Data Engineer

    7 days ago


    New Delhi, India CX Data Labs Full time

    Data Engineer About CX Data Labs: At CX Data Labs, we believe that by systematically understanding and adapting to changing customer preferences, companies can sustainably grow their business. We help our clients realize this vision through our advisory and implementation services in Digital, Data, and Analytics competencies, bridging the gap between...

  • Data Engineer

    2 weeks ago


    New Delhi, India CX Data Labs Full time

    Data EngineerAbout CX Data Labs: At CX Data Labs, we believe that by systematically understanding and adapting to changing customer preferences, companies can sustainably grow their business. We help our clients realize this vision through our advisory and implementation services in Digital, Data, and Analytics competencies, bridging the gap between Strategy...

  • Data Engineer

    2 weeks ago


    New Delhi, India CX Data Labs Full time

    Data EngineerAbout CX Data Labs: At CX Data Labs, we believe that by systematically understanding and adapting to changing customer preferences, companies can sustainably grow their business. We help our clients realize this vision through our advisory and implementation services in Digital, Data, and Analytics competencies, bridging the gap between Strategy...

  • Data Engineer

    2 weeks ago


    New Delhi, India CX Data Labs Full time

    Data Engineer About CX Data Labs: At CX Data Labs, we believe that by systematically understanding and adapting to changing customer preferences, companies can sustainably grow their business. We help our clients realize this vision through our advisory and implementation services in Digital, Data, and Analytics competencies, bridging the gap between...

  • Data Engineer

    7 days ago


    delhi, India Domnic Lewis International Full time

    Greetings from Domniclewis !!Hello Team ,We are hiring for a product based MNC conglomerate organisation in Bangalore !Experience - 4-8 yearsPosition - Data EngineerLocation - BangaloreSalary - 40-45 lpaResponsibilities:Collaborate with the data team to design and develop BI and analytics solutions.Implement batch and near real-time data movement patterns,...

  • AWS Data Engineer

    6 hours ago


    Delhi, India Mactores Full time

    Mactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores has been enabling businesses to accelerate their value through automation by providing automated, agile, and secure end-to-end data solutions. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward with digital...

  • Aws Data Architect

    5 months ago


    Delhi, India Tata Consultancy Services Full time

    Inviting Applications for AWS Data Architect with Data bricks Qualifications :BACHELOR OF ENGINEERING


  • Delhi, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup cyber security company that specializes in protecting businesses and organizations from cyber threats. Our services include cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We provide customized and affordable solutions to meet the specific needs of our clients, regardless...


  • Delhi, India People Tech Group Inc Full time

    Hello Linkedin connectionsWe are Hiring '' Lead /Data Architect Aws Devops Engineer '' and below are the requirements. This will be through ''People Tech Group Company''.Position : Aws Lead Devops Engineer/Data ArchitectCompany : People Tech Group ( Mnc)Mode of Work: WFOExperience: 6+yrsLocation : Bangalore OnlyMandatory Skill: Aws, cloud engineer,...

  • Lead Data Engineer

    4 months ago


    Delhi NCR/Gurgaon/Gurugram, India HuQuo Consulting Pvt. Ltd. Full time

    Responsibilities :- Should possess hands-on experience in working on some of the relational and non-relational databases (Oracle/SQL Server/DB2/PostgreSQL/MySQL/Golden Gate/Data Guard) on AWS and/or on-prem infrastructure.- 3+ years' Experience with AWS Services like AWS RDS, Aurora, EC2, S3, DMS, AWS Backups, and DynamoDB.- 3+ years' Experience...

  • Data Engineer

    6 days ago


    Delhi, India iO Associates - UKEU Full time

    Position: Data EngineerPay rate: INR 2,037 per hourlocation: BangaloreRole Type: 4 Month contract with extensionPosition: Hybrid roleIO Associates seeks a Data Engineer for the Bangalore site. The company provides IT services focused on software procurement, cloud solutions, and digital transformation. It supports organizations in optimizing costs,...

  • Data Engineer

    2 weeks ago


    Delhi, India Truelancer.com Full time

    Job Title:Sr Data EngineerExperience:5 - 9 yrsLocation:Work from Office ,ChennaiMandatory Skills:AWS Data Services+Strong in SQL QueriesAs a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining data pipelines and analytics solutions. You will work with a range of AWS technologies and data tools to ensure our data...

  • AWS DevOps Engineer

    6 days ago


    Delhi, India Space Multimedia Full time

    Space is an innovative and dynamic company that specializes in leading businesses through transformative journeys in the digital era. They are pioneers in driving innovation and helping organizations transition into digitally mature entities. With a wide range of cutting-edge services, including web enterprise application development, AI & ML development,...

  • Data Engineer

    7 days ago


    delhi, India TechEnhance Full time

    Company DescriptionTechEnhance is an Digital Transformation solutions provider based in Bengaluru that specializes in productivity optimization for businesses through the use of artificial intelligence, Cloud, DevOps, app development and custom development.Role DescriptionThis is a full-time hybrid role for a Data Engineer at TechEnhance in...

  • Data Engineer

    1 month ago


    Delhi, India Wenger & Watson Full time

    Should have a minimum 2+ years in Data Engineering, Data Analytics platform. Should have strong hands-on design and engineering background in AWS, across a wide range of AWS services with the ability to demonstrate working on large engagements. Should be involved in Requirements Gathering and transforming them to into Functionally and technical design....


  • new delhi, India CX Data Labs Full time

    Business Intelligence EngineerAbout CX Data LabsAt CX Data Labs, we believe that by systematically understanding and adapting to changing customer preferences, companies can sustainably grow their business. We help our clients realize this vision through our advisory and implementation services in Digital, Data, and Analytics competencies bridging the gap...