▷ 3 Days Left: Senior Data Engineer

1 week ago

Bengaluru, India Josys Full time

Location: Bengaluru, Karnataka, India

About The Role

We're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining our data systems on AWS. You'll use your strong skills in big data tools and cloud technology to help our analytics team get valuable insights from our data. You'll be in charge of the whole process of our data pipelines, making sure the data is good, reliable, and fast.

What You'll Do

- Design and build efficient data pipelines using Spark / PySpark / Scala.
- Manage complex data processes with Airflow, creating and fixing any issues with the workflows (DAGs).
- Clean, transform, and prepare data for analysis.
- Use Python for data tasks, automation, and building tools.
- Work with AWS services like S3, Redshift, EMR, Glue, and Athena to manage our data infrastructure.
- Collaborate closely with the Analytics team to understand what data they need and provide solutions.
- Help develop and maintain our Node.js backend, using Typescript, for data services.
- Use YAML to manage the settings for our data tools.
- Set up and manage automated deployment processes (CI/CD) using GitHub Actions.
- Monitor and fix problems in our data pipelines to keep them running smoothly.
- Implement checks to ensure our data is accurate and consistent.
- Help design and build data warehouses and data lakes.
- Use SQL extensively to query and work with data in different systems.
- Work with streaming data using technologies like Kafka for real-time data processing.
- Stay updated on the latest data engineering technologies.
- Guide and mentor junior data engineers.
- Help create data management rules and procedures.

What You'll Need

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 6-8 years of experience as a Data Engineer.
- Strong skills in Spark and Scala for handling large amounts of data.
- Good experience with Airflow for managing data workflows and understanding DAGs.
- Solid understanding of how to transform and prepare data.
- Strong programming skills in Python for data tasks and automation..
- Proven experience working with AWS cloud services (S3, Redshift, EMR, Glue, IAM, EC2, and Athena).
- Experience building data solutions for Analytics teams.
- Familiarity with Node.js for backend development.
- Experience with Typescript for backend development is a plus.
- Experience using YAML for configuration management.
- Hands-on experience with GitHub Actions for automated deployment (CI/CD).
- Good understanding of data warehousing concepts.
- Strong database skills - OLAP/OLTP
- Excellent command of SQL for data querying and manipulation.
- Experience with stream processing using Kafka or similar technologies.
- Excellent problem-solving, analytical, and communication skills.
- Ability to work well independently and as part of a team.

Bonus Points

- Familiarity with data lake technologies (e.g., Delta Lake, Apache Iceberg).
- Experience with other stream processing technologies (e.g., Flink, Kinesis).
- Knowledge of data management, data quality, statistics and data governance frameworks.
- Experience with tools for managing infrastructure as code (e.g., Terraform).
- Familiarity with container technologies (e.g., Docker, Kubernetes).
- Experience with monitoring and logging tools (e.g., Prometheus, Grafana).

  • 3 Days Left! Senior Data Engineer

    2 weeks ago

    Bengaluru, India Quantiphi Full time

    Role: Senior Data Engineer Experience Level: 3 to 6 Years Work location: Mumbai, Bangalore, Trivandrum (Hybrid Only) Required Skills: ● Bachelor’s degree in Computer Science or similar field or equivalent work experience. ● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects. ● Expert with data warehousing...

  • 3 Days Left Digital Engineering Sr. Staff Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 336855 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Staff Engineer to join our team in Bangalore Karn taka IN-KA India IN At NTT DATA we...

  • Senior Data Engineer

    1 week ago

    Bengaluru, India Techinduct Services Pvt. Ltd Full time

    We’re seeking a Senior Data Engineer to join our client, a world-class education consulting firm, in building robust data solutions that drive innovation and scalability. In this role, you’ll design and optimize high-performance data pipelines, ensuring seamless data flow to support advanced analytics and business intelligence. Collaborating with...

  • ▷ 3 Days Left: Senior Data Engineer

    3 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Data Engineer - Senior Engineer/Manager Experience Range: 10 - 18 years Location: Bengaluru, India Primary Skills Required: Position 1(Required Exp Range - 12-18 years): Java, Scala, Spark, Python, Kafka, Airflow, SQL, Databricks, Snowflake, Hive, AWS, Oracle Exadata, SAP Data Services Position 2(Required Exp Range - 10-15 years): Java, Scala, Spark,...

  • [3 Days Left] Senior ML Engineer

    2 weeks ago

    Bengaluru, India Razorpay Full time

    Job Description As part of the DS teamat Razorpay, you'll work with some of the smartest engineers/architects/data scientists/product leaders in the industry and have the opportunity to solve complex and critical problems for Razorpay. As a Senior MLE, you will also have the opportunity to partner with and be mentored by senior engineers across the...

  • ▷ [3 Days Left] Senior Data Engineer - Python/ETL

    23 hours ago

    Bengaluru, India Wits Innovation Lab Full time

    Job Description Job Description Our engineering team is looking for a Data Engineer who is very proficient in python, has a very good understanding of AWS cloud computing, ETL Pipelines and demonstrates proficiency with SQL and relational database concepts. In this role you will be a very mid-to senior-level individual contributor guiding our migration...

  • ▷ 3 Days Left! Senior Data Scientist

    7 days ago

    Bengaluru, India Thomson Reuters Full time

    Job Description At Thomson Reuters, our strategic vision is to build a world-class Data & Analytics company by fostering a data-driven culture across the organization. We are seeking a highly motivated Senior Data Scientist with strong organizational and technical skills to play a pivotal role in our data-driven journey. In this position, you will leverage...

  • ▷ (3 Days Left) Senior Program Manager

    5 days ago

    Bengaluru, India NTT DATA, Inc. Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion it's a place where you can grow, belong and thrive. Your day at NTT...

  • [3 Days Left] Data Engineer

    5 days ago

    Bengaluru, India Talent Worx Full time

    About Position: We are looking for an experienced and talented Data Engineer- Databricks to join our growing data engineering team. Role: Data Engineer- Databricks • Location: Pune and Bangalore • Experience: 3 Years- 12 Years • Job Type: Full Time Employment What You'll Do: • Design and maintain scalable data pipelines using Databricks and...

  • 3 Days Left: Bioinformatics Consultant

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Bioinformatics Consultant to join our team in Bangalore Karn xc4 x81taka IN-KA India IN Primary Job Duties Build and...