Senior Data Engineer/Architect

2 weeks ago

Bengaluru Karnataka India, Karnataka Infosys Full time

As a Software Developer you will work in a constantly evolving environment, due to technological advances and the strategic direction of the organization you work for. You will create, maintain, audit, and improve systems to meet particular needs, often as advised by a systems analyst or architect, testing both hard and software systems to diagnose and resolve system faults. The role also covers writing diagnostic programs and designing and writing code for operating systems and software to ensure efficiency. When required, you will make recommendations for future developments Benefits of Joining UsChallenging Projects : Work on cutting-edge projects and solve complex technical problems.Career Growth : Advance your career quickly and take on leadership roles.Mentorship : Learn from experienced mentors and industry experts.Global Opportunities : Work with clients from around the world and gain international experience.Competitive Compensation : Receive attractive compensation packages and benefits.If you're passionate about technology and want to work on challenging projects with a talented team, becoming an Infosys Power Programmer could be a great career choice.Mandatory SkillsAWS Glue, AWS Redshift/Spectrum, S3, API Gateway, Athena, Step and Lambda functionsExperience in Extract Transform Load (ETL) and Extract Load & Transform (ELT) data integration pattern.Experience in designing and building data pipelines.Development experience in one or more object-oriented programming languages, preferably PythonJob Specs5+ years of in depth hands on experience of developing, testing, deployment and debugging of Spark Jobs using Scala in Hadoop PlatformIn depth knowledge of Spark Core, working with RDDs, Spark SQLIn depth knowledge on Spark Optimization Techniques and Best practicesGood Knowledge of Scala Functional Programming: Try, Option, Future, CollectionsGood Knowledge of Scala OOPS: Classes, Traits and Objects (Singleton and Companion), Case ClassesGood Understanding of Scala Language Features: Type System, Implicit/GivensHands on experience of working in Hadoop Environment (HDFS/Hive), AWS S3, EMRPython programming skillsWorking experience on Workflow Orchestration tools like Airflow, OozieWorking with API calls in ScalaUnderstanding and exposure to file formats such as Apache AVRO, Parquet, JSONGood to have knowledge of Protocol Buffers and Geospatial data analytics.Writing Test cases using frameworks such as scalatest.Good Knowledge of Build Tools such as: Gradle & SBT in depthExperience on using GIT, resolving conflicts, working with branches.Good to have worked on some workflow systems as AirflowStrong programming skills using data structures and algorithms.Excellent analytical skillsGood communication skills Qualification7-10 Yrs in the industryBE/B.tech CS or equivalent

  • Senior Data Architect

    4 days ago

    Bengaluru, Karnataka, India, Karnataka Tredence Inc. Full time

    Designation: Senior Manager (Databricks Architect)Location: Bengaluru, Chennai, Kolkata, Gurugram, Pune and Hyderabad.Profile Summary: We are seeking an experienced professional who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover...

  • Senior Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Rakuten Symphony Full time

    Job Title: Senior Data Architect – OSSMinimum - 10+ years of hands-on experience in data architecture, data modelling, and designing large-scale data platforms.Location: Bangalore (Onsite)Why should you choose us?Rakuten Symphony is a Rakuten Group company, that provides global B2B services for the mobile telco industry and enables next-generation,...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Publicis Production Full time

    Job Summary:We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting, building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with...

  • Senior Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Fiserv Full time

    What does a successful Advisor, Data Architect do at Fiserv? As a member of our Data Commerce Solutions group, you will build and take ownership of the design and development of data engineering projects within Fiserv’s Enterprise Data Commerce Solutions division. You will apply your depth of knowledge and expertise to all aspects of the data engineering...

  • Senior Data Architect

    3 days ago

    Bengaluru, Karnataka, India Aceis Services Pvt Ltd Full time ₹ 85,600 - ₹ 21,17,359 per year

    Position: Senior Data ArchitectLocation: Bangalore Coke Office (Hybrid)Experience: 7-10 yrsWe are looking for an experienced Senior Data Architect with proven expertise in Data Lake architecture and implementation. The candidate will design and lead enterprise-scale data lake strategies across cloud and hybrid environments, enabling advanced analytics,...

  • AWS Data engineer/Architect

    2 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Summary: In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using...

  • Senior Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ERP Senior Specialist Job Title: Azure Senior Data Engineer We are looking a highly skilled and experienced Senior Azure Data Engineer to join our team. This role requires deep expertise in Azure Data Factory and Databricks, including CI/CD setup for Databricks, and strong proficiency in ETL, SQL, and modern data engineering practices. You will be the...

  • Platform Engineer-Data

    4 days ago

    Bengaluru, Karnataka, India, Karnataka ValueLabs Full time

    We’re Hiring: Senior Technology Engineer – DevOps & Big DataLocation: ValueLabsExperience: 8+ YearsEmployment Type: Full-timeAt ValueLabs, we’re on a mission to revolutionize our data platform with full automation, containerization, and cutting-edge distributed architecture. We're looking for a Senior Technology Engineer (STE) who thrives in fast-paced...

  • Senior Data Engineer

    3 days ago

    Bengaluru, Karnataka, India, Karnataka Sonata Software Full time

    Mandatory* Experience building data pipelines* Highly proficient in python, Data frames* Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB* Highly proficient in SQL Query* Snowflake or experience with similar analytics database* Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code...

  • Senior Data Engineer cum Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleAs a Senior Data Engineer cum Data Scientist, you will be a key contributor to designing, developing, and operating advanced data architectures, pipelines, and analytics solutions within the Palantir ecosystemYou will leverage your deep expertise in Palantir Foundry and Gotham platforms, combined with strong AI capabilities, to solve complex...