Data Engineer

7 days ago

Bengaluru, Karnataka, India Careernet Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year
We are looking for a Senior Software Engineer, Ideal candidate would be someone with a passion for Clean Code, Scalable architectures, Test Driven Development and DevOps. Someone who loves getting hands dirty with code and learns everyday RESPONSIBILITIES
  • Hands on developer/lead to work on data modeling, code, and test iteratively on technical solutions for monitoring and analytics requirements.
  • Coordinates with product and leads development team, leads scrum team/board management.
  • Implement ETL processes, UI and dashboards for appropriate trends and alerts in BI tools (Superset, Spotfire, QuickSight, etc.) for monitoring.
  • Plan, develop, execute and maintain automated unit, functional test cases; develop modular, robust, and maintainable automation scripts.
  • Implement automation in the areas of Cloud resource provisioning, unit testing, code coverage, static code analysis and vulnerability scanning with CI/CD process.
  • Must have strong analytical and technical skills with passion to deep dive on data in troubleshooting , devise techniques for problem resolution.
  • Promote a culture of best practices with peer code reviews and extreme ownership for continuous incremental delivery.
  • Maintain and document standards, best practices, and design/architecture patterns.
  QUALIFICATIONS AND SKILLS
  • 2-7 years of experience with ETL automation, SQL and BI Tools experience is a must (Superset, TIBCO Spotfire, etc.)
  • Programming experience Python/Java and desire to write and review code 70% of time. 
  • Familiarity with relational and big data technology stack such as Postgres, Hadoop and columnar Storage formats Parquet
  • Familiarity of Linux platforms with knowledge of shell scripting.
  • Hands-on experience with Spark, Spark SQL, Spark on K8s, M/R Framework and Big Data Technology Stack.
  • Experience developing cloud-hosted (AWS), containerized applications and services is plus.
  • AWS Components: EKS, EMR, EC2, S3 storage, Lambda, Relational Database Service, Simple Notification Service (SNS), Elasticache, etc.
  • Experience with source code control tools. Gitlab experience is a plus.
  • Knowledge of networking and protocols: HTTP/HTTPS, TLS/SSL/certificates, TCP/IP is plus
  • Knowledge of CI/CD processes, testing frameworks, practices and tools (Jenkins, jUnit, Terraform, JFrog, Jacoco, SonarQube, etc.) is a plus

  • Data Entry Operator

    1 week ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Technical Lead- Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data & AI Engineer Lead

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Sr Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards...

  • Sr Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Req ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...

  • Data Engineer Senior Consultant

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Req ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...

  • Data Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Hands-on experience in building and managing data...

  • AWS Sr Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...

  • FID Federal Risk Applications Data Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Our focus is developing systems serving as a data integration and feeding platform, ensuring that calculation results and other data initiated in our Division reaches our downstream clients and meeting all their requirements. The main challenges in this area are the volume of the data (feeding hundreds of gigabytes daily), interfacing with multiple other...