Target - Data Engineer - Scala/Spark/Hadoop

4 weeks ago


Bengaluru, India Target Corporation Full time

Job Description :


As a Data Engineer / Senior Data Engineer you serve as a specialist in the engineering team that supports the product. You help develop and gain insight in the application architecture. You can distill an abstract architecture into concrete design and influence the implementation. You show expertise in applying the appropriate software engineering patterns to build robust and scalable systems.


You are an expert in programming and apply your skills in developing the product. You have the skills to design and implement the architecture on your own, but choose to influence your fellow engineers by proposing software designs, providing feedback on software designs and/or implementation.


You show good problem solving skills and can help the team in triaging operational issues. You leverage your expertise in eliminating repeat occurrences. Use your skills, experience and talents to be a part of groundbreaking thinking and visionary goals. As a Sr. Engineer, you'll take the lead as you.


Role :

  • Use your technology acumen to apply and maintain knowledge of current and emerging technologies within specialized area(s) of the technology domain.
  • Evaluate new technologies and participate in decision-making, accounting for several factors such as viability within Target's technical environment, maintainability, and cost of ownership.
  • Initiate and execute research and proof-of-concept activities for new technologies.
  • Manage total product, financials and forecasting.
  • Lead the design, lifecycle management, and total cost of ownership of services.
  • Lead and conduct code review, design review, testing, and debugging activities at the application level.
  • Lead functional design and architecture discussions with understanding of process flows and system diagrams to enable design decisions.
  • Participate in routine and non-routine construction, automation, and implementation activities, ensuring successful implementation with architectural and operational requirements and best practices met.
  • Provide technical oversight and coach others to resolve complex and severe technical issues.
  • Lead disaster recovery activities and contribute to disaster recovery planning.
  • Embed data quality protocols throughout data acquisition, processing, storage, and operational use.

Core responsibilities of this job are described within this job description. Job duties may change at any time due to business needs.

About you :

  • 4 year degree or equivalent experience
  • 2+ Years of software development experience
  • Demonstrates strong domain-specific knowledge regarding Target's technology capabilities, and key competitors' products and differentiating features
  • Working knowledge on package-specific configuration and deployment along with ability to build custom solutions
  • Have experience in building Data Pipelines using Scala, Spark, Hadoop, HiveQL etc.
  • Have experience with streaming frameworks such as Kafka.
  • Have experience with Data Warehousing, Data Modelling and Data Profiling.
  • Designs new testing methods and resolves routine and non-routine technical issues with minimal assistance
  • Demonstrates strong proficiency in core development platforms within own domain
  • Builds strong commitment within the team to support the appropriate team priorities
  • Clearly communicates Agile concepts to partners within product team
  • Demonstrates a solid understanding of the impact of own work on the team and/or guests
  • Writes and organizes code using multiple computer languages, including distributed programming and understand different frameworks and paradigm
  • Delivers high-performance, scalable, repeatable, and secure deliverables with broad impact (high throughput and low latency)
  • Influences and applies data standards, policies, and procedures
  • Maintains technical knowledge within areas of expertise
  • Stays current with new and evolving technologies via formal training and self-directed education

(ref:hirist.tech)

  • Bengaluru, India Target Corporation Full time

    Role :- Use your technology acumen to apply and maintain knowledge of current and emerging technologies within specialized area(s) of the technology domain.- Evaluate new technologies and participate in decision-making, accounting for several factors such as viability within Target's technical environment, maintainability, and cost of ownership.-...

  • Big Data

    1 month ago


    Bengaluru, India Riverforest Connections Full time

    **Job Description**: **Strong proficiency Scala + Spark (Hadoop) with Java (mandatory)** Database experience preferably with DB2, Sybase, or Oracle - Complete SDLC process and Agile Methodology (Scrum) - Version control - Git - Spring Skill Desired: - Previous experience in Trade Surveillance or working with data from the order lifecycle - High quality...


  • Bengaluru, India Target Corporation Full time

    Job Description :- Senior Data Engineer you serve as a specialist in the engineering team that supports the product.- You help develop and gain insight in the application architecture.- You can distill an abstract architecture into concrete design and influence the implementation.- You show expertise in applying the appropriate software engineering patterns...

  • Principal Consultant

    3 weeks ago


    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Big Data Consultant

    4 weeks ago


    Bengaluru, India Nilasu consulting Full time

    Summary :We are seeking a highly skilled consultant with expertise in Spark/Scala and Python to join our team. You will play a key role in developing and maintaining big data applications using Spark and Scala with a focus on functional programming principles. Additionally, your experience in Python and microservices architecture will be valuable in building...

  • Principal Consultant

    3 weeks ago


    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people –...

  • Hadoop Developer

    3 weeks ago


    Bengaluru, India Andor Tech Full time

    Job Description :We are seeking a skilled Hadoop Developer with mandatory working experience in Elasticsearch to join our team. The ideal candidate should have a minimum of 2 years of experience in Hadoop and Spark development. This role will involve working with large datasets and implementing data processing solutions using Hadoop and Spark, with a...

  • Senior Data Engineer

    2 months ago


    Bengaluru, India CliqHR Full time

    Job Description :Mandatory Skills : Microsoft Azure, Hadoop, Spark, Databricks, Airflow, Kafka, Py sparkRequirements :- Experience working with distributed technology tools for developing Batch and Streaming pipelines using SQL, Spark, Python, Airflow, Scala, Kafka- Experience in Cloud Computing, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new...


  • Bengaluru, India IQVIA RDS India Pvt Ltd Full time

    Job Title / Primary Skill : Big Data DeveloperManagement Level : G130Years of Experience : 2 to 5 yearsJob Location : Bangalore (Hybrid)Must Have Skills : Bigdata Developer, Hadoop, Hive, Scala, and Spark.Educational Qualification : BE/BTech/ MTech/ MCARole & responsibilities : - Minimum 3+ years of experience in Big Data development.- Good understanding of...


  • Bengaluru, India Target Full time

    About us: Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture. . We are looking for a motivated and enthusiastic Engineer to join ITSM Data platform team. In this role, you will work closely with senior data engineers and other stakeholders to develop, maintain, and...


  • Bengaluru, India Zype Full time

    About Us :Zype is a leading personal loan app that offers a credit line product to its customers. With a focus on convenience and accessibility, Zype provides users with a seamless borrowing experience. By leveraging technology and data analytics, Zype is able to offer competitive rates and flexible repayment options, making it a popular choice among...

  • Big Data Engineer

    1 week ago


    Bengaluru, India Coforge Full time

    Job DescriptionJob description Role and responsibilities : -Experience required- 4 to 10 YearsCreating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation.Debugging the production failures and identifying the solution.- Developing efficient frameworks for development and testing using...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, India Coforge Full time

    Job Description Job description Role and responsibilities : - Experience required- 4 to 10 Years Creating Project Technical Documentation - Designing Solution architecture, and work on Data Ingestion, Preparation and Transformation. Debugging the production failures and identifying the solution. - Developing efficient frameworks for...

  • Data Engineer

    2 months ago


    Bengaluru, India Huquo Full time

    Job Description : - Commercial experience leading on client-facing projects, including working in close-knit teams- 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / Relational DBs)- 3+ years of experience working on projects within the cloud ideally AWS or Azure- Data Warehousing experience with cloud products like Snowflake,...

  • Spark+ Scala+ SQL

    1 month ago


    Bengaluru, India RARR Technologies Full time

    **Job Details - Spark+ Scala+ SQL**: **Job ID**: - RARR Job 2943**Job Title**: - Spark+ Scala+ SQL**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, CHENNAI, HYDERABAD, MUMBAI, PUNE**Total Experience**: - 6 - 12 Years**Skills**: - SCALA, SPARK**Posted - **01/02/2023 **Job Description**: **JD Details**: - Should have at least 6 to 12...

  • Data Engineer

    4 weeks ago


    Bengaluru, India Squareroot Consulting Pvt Ltd Full time

    Role : Data EngineerLocation : BangaloreExperience : 3+ Yrs.Responsibilities :- Develop and maintain scalable data pipelines for batch processing using Apache Spark in Big Data projects.- Utilize Scala programming language to implement efficient data processing solutions.- Collaborate with cross-functional teams to understand data requirements and design...

  • Data Engineer

    4 weeks ago


    Bengaluru, India Talent500 Full time

    Responsibilities for Data Engineer:- Create and maintain optimal data pipeline architecture,.- Assemble large, complex data sets that meet functional / non-functional business requirements.- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater...

  • Data Engineer III

    4 weeks ago


    Bengaluru, India Freelance Full time

    Job Description :Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and architects...

  • Big Data Engineers

    2 months ago


    Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Big Data

    1 month ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Good work experience & Proven experience working on Python (Data Engineering), Spark/Scala. Qualifications :Undergraduate