Senior Data Engineer

2 weeks ago

Bengaluru, Karnataka, India Arcana Analytics Full time

Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer. Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate understanding of data structures, algorithms, and system design, becomes the cornerstone of innovative solutions. This pivotal role not only demands your proficiency in developing and elevating compute and I/O-intensive applications but also ensures their peak performance and unwavering reliability.

Responsibilities:

  • Develop and implement real-time data ingestion and processing systems.
  • Design, build, and operationalize large-scale enterprise data solutions and applications.
  • Create and manage production data pipelines, from ingestion to consumption, within a big data architecture using PySpark.
  • Leverage expertise in Python, Airflow, SQL, and cloud platforms to build robust solutions (strong knowledge of these is essential).
  • Translate complex business challenges into scalable and efficient technical solutions.
  • Work collaboratively with a high-performing data engineering team, owning the full lifecycle of solution implementation.

Requirements:

  • Bachelor's Degree in Computer Science, Information Technology, or a similar discipline.
  • 3 - 8 years of professional experience in data engineering or related fields.
  • Proven experience with ETL processes, data integration, and handling large-scale datasets using PySpark.
  • Strong understanding of data engineering concepts like ETL, near/real-time streaming, data structures, and workflow management.
  • Experience with version control tools like Git/GitHub.
  • Proficiency in SQL and Data Warehouse concepts.
  • Experience working with SQL or NoSQL databases like Cassandra, MongoDB, or HBase.
  • Knowledge of AWS technologies such as EMR, RedShift, Kinesis, Lambda, Glue, S3 IAM, CloudWatch, and big data tools like Hadoop/EMR, Hive, and Sqoop.


  • Senior Data Engineer cum Data Scientist

    6 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...

  • Data Engineer Senior Consultant

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Req ID: 341131NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Location: | Experience:...

  • Senior Data Scientist

    7 days ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    5 days ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Software Engineer, Platform

    7 hours ago

    Bengaluru, Karnataka, India vaga para Senior Software Engineer, Platform na Headout Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Why Headout?We're a rocketship: 9-figure revenue, record growth, and profitableWith $130M in revenue, guests in 100+ cities, and 18 months of profitability, Headout is the fastest-growing marketplace in the travel industry, and we're just getting started. We've raised $60M+ from top-tier investors and are building a durable company for the long term —...

  • Senior AI Engineer

    7 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 1,20,000 - US$ 1,80,000 per year

    Req ID: 345129NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior AI Engineer - Senior Specialist to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior AI...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Build scalable data pipelines from structured and unstructured sources Design ontologies that model business entities, relationships, and process flows Collaborate with domain SMEs and ML engineers to structure agent inputs and outputs Implement transformation, validation, and enrichment logic across diverse datasets Maintain and optimize cloud data...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....