Big Data Engineer

6 months ago


Bengaluru, India Hexaware Technologies Full time

Description

Data Engineer: Primary : ADF, SQL

Seconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption

Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various enterprise architects, Information security teams, Data management team, to ensure the architected solution meets all the needs of a customer, from a functionality perspective and IT solution engineering perspective. •Translate business requirements into technology solutions. •Lead designing of all aspects of our data solution including artifact creation such as diagrams, playbooks, and other technical documents Skills: •Over all 5 to 8 years of experience with Data Management & Big Data and Analytics. •At least 2 to 3 years of experience in implementing the data solutions on MS Azure using Azure Data Factory. •Must have strong SQL background and ability to tune the SQL for optimized ETL jobs. •one to two years of experience in Azure Synapse Analytics is plus. •Extensive hands-on experience in data warehousing design, tuning and ETL/ELT process development by using cloud native technologies. •Apache Spark experience using Scala or PySpark or pre-packaged tools like Databrick is plus. •At least one year of experience with API based/real time integrations using Kafka or similar technologies. •At least 1 to 2 years of experience with big data using spark and java for data processing. •Developing the CICD pipeline for Azure Infrastructure, version control strategy and Integrate source control (git, GitHub, azure repos). •At least one year experience with unified data governance solution using MS Purview.  •In-depth understanding of various storage services offered by Azure. •Experience with implementation of data security, encryption, PII/PSI legislation, identity and access management across sources and environments. •Experience with data process Orchestration, end-to-end design and build process of Near-Real Time and Batch Data Pipelines. •Certification in Azure fundamentals (AZ-900) and Azure data engineering (DP-203) is must. •Strong client-facing communication and facilitation skills.
  • Big Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Wipro Full time

    Job Summary:We are seeking a highly skilled Big Data Engineer to join our team at Wipro. This is a fantastic opportunity for individuals with expertise in designing, building, and maintaining large-scale data processing systems.About the Role:The ideal candidate will have hands-on experience with big data technologies such as Hadoop, Spark, and Kafka. You...

  • Big Data Engineer

    5 months ago


    Bengaluru, India Telescopp Full time

    Job OverviewWe are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to support our client's...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...

  • Big data Engineer

    3 weeks ago


    Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full time

    DescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...

  • Big Data Engineer

    6 months ago


    Bengaluru, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big data engineer

    1 month ago


    Bengaluru, India Mercedes-Benz Full time

    Tätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:Data Analytics @ GCSPGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:..4Veröffentlichungsdatum:..4Stellennummer:MER3GEIArbeitszeit:Vollzeit BewerbenAufgaben · Mandatory: Deep hands-on...

  • Big Data Engineer 3

    1 month ago


    Bengaluru, Karnataka, India Oracle Full time

    Job SummaryWe are seeking an experienced Big Data Engineer to join our team at Oracle. This role involves designing, developing, and troubleshooting large-scale data systems.Key ResponsibilitiesDesign and implement data processing pipelines using Big Data technologiesDevelop and maintain large-scale data storage systemsCollaborate with cross-functional teams...


  • Bengaluru, India NETSACH GLOBAL Full time

    Greetings from Netsach - A Cyber Security Company.Netsach is currently hiring Big Data Engineer/Architect is responsible for designing, developing, and maintaining large-scale data processing systems and architecture. This role involves working closely with data scientists, analysts, and other stakeholders to ensure data systems are scalable, secure, and...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    LTIMindtree is a global leader in digital transformation consulting and technology services. We are seeking an experienced Big Data Engineer to join our team in Bengaluru, NCR Noida, Gurugram, or Delhi.The ideal candidate will have 5+ years of experience in working with big data technologies such as Pyspark, SQL, and Hive. The role involves designing,...


  • Bengaluru, Karnataka, India Walmart Global Tech India Full time

    About the RoleWe are seeking an experienced Big Data Engineer to join our team at Walmart Global Tech India. As a key member of our engineering team, you will play a critical role in designing, building, and deploying cutting-edge big data solutions that drive business value for our customers.

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India LTIMindtree Full time

    About UsLTIMindtree is a leading global technology consulting and services company, helping customers reimagine their businesses for the digital age. We have expertise in big data analytics.Job OverviewWe are seeking a skilled Data Engineer - Big Data Analytics to join our team. The successful candidate will be responsible for designing, developing, and...


  • Bengaluru, Karnataka, India GForce Consulting Solutions (OPC) Pvt. Ltd. Full time

    Senior Software EngineerGForce Consulting Solutions (OPC) Pvt. Ltd., a leading global IT services company, is seeking an experienced Senior Software Engineer for our Multinational Client.About the RoleThis role involves working with our client to design and develop cutting-edge big data solutions using AWS Data Bricks, S3, Redshift, EC2, Lambda, Azure data...


  • Bengaluru, Karnataka, India AppSierra Solutions Pvt Ltd Full time

    We are seeking a seasoned data engineer to lead the development and deployment of big data pipelines using AWS DataBricks.With 5-7 years of experience in software development on AWS, you will have strong hands-on knowledge of AWS DataBricks, DevOps, Kubernetes, and cloud services such as S3, Redshift, EC2, and Lambda. Additionally, you will have extensive...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, India Eximietas Design Full time

    6+ yearsof experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience inJava● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of data...

  • Data Engineer

    4 weeks ago


    Bengaluru, India NTT DATA Full time

    Job Description Req ID: 302683 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Off Shore) - Big ID to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Big Data Engineer

    5 months ago


    Bengaluru, India Infogain Full time

    Big Data Engineer (Standard) with skills Data Engineering, Data Warehouse, Big Data, databricks, Apache Spark, Azure Datalake, Pyspark for location Bangalore, India Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Advanced knowledge of Azure data services such as Azure SQL Database, Azure...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, India Eximietas Design Full time

    6+ years of experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience in Java● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of...

  • Big data engineer

    4 weeks ago


    Bengaluru, India Eximietas Design Full time

    6+ years of experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience in Java● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of...


  • Bengaluru, Karnataka, India Wipro Full time

    Job SummaryWe are seeking an Expert Big Data Engineer to join our team at Wipro. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark.About the RoleThis is a senior-level position that requires excellent knowledge of Spark, Scala, and PySpark. You...

  • Data Engineer

    2 months ago


    Bengaluru, India Coders Brain Technology Private Limited Full time

    Qualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...