Big Data Engineer
6 months ago
Description
Data Engineer: Primary : ADF, SQLSeconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption
Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various enterprise architects, Information security teams, Data management team, to ensure the architected solution meets all the needs of a customer, from a functionality perspective and IT solution engineering perspective. •Translate business requirements into technology solutions. •Lead designing of all aspects of our data solution including artifact creation such as diagrams, playbooks, and other technical documents Skills: •Over all 5 to 8 years of experience with Data Management & Big Data and Analytics. •At least 2 to 3 years of experience in implementing the data solutions on MS Azure using Azure Data Factory. •Must have strong SQL background and ability to tune the SQL for optimized ETL jobs. •one to two years of experience in Azure Synapse Analytics is plus. •Extensive hands-on experience in data warehousing design, tuning and ETL/ELT process development by using cloud native technologies. •Apache Spark experience using Scala or PySpark or pre-packaged tools like Databrick is plus. •At least one year of experience with API based/real time integrations using Kafka or similar technologies. •At least 1 to 2 years of experience with big data using spark and java for data processing. •Developing the CICD pipeline for Azure Infrastructure, version control strategy and Integrate source control (git, GitHub, azure repos). •At least one year experience with unified data governance solution using MS Purview. •In-depth understanding of various storage services offered by Azure. •Experience with implementation of data security, encryption, PII/PSI legislation, identity and access management across sources and environments. •Experience with data process Orchestration, end-to-end design and build process of Near-Real Time and Batch Data Pipelines. •Certification in Azure fundamentals (AZ-900) and Azure data engineering (DP-203) is must. •Strong client-facing communication and facilitation skills.-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Wipro Full timeJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Wipro. This is a fantastic opportunity for individuals with expertise in designing, building, and maintaining large-scale data processing systems.About the Role:The ideal candidate will have hands-on experience with big data technologies such as Hadoop, Spark, and Kafka. You...
-
Big Data Engineer
5 months ago
Bengaluru, India Telescopp Full timeJob OverviewWe are looking for a talented Big Data Engineer to join our team in Bengaluru. This is a mid-level, full-time position requiring a minimum of 4 years to a maximum of 6 years of relevant work experience. As a Big Data Engineer at Telescopp, you will be responsible for developing, testing, and maintaining big data solutions to support our client's...
-
Cloud Data Engineer for Big Data Processing
4 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeAbout the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...
-
Big data Engineer
3 weeks ago
Bengaluru / Bangalore, Gurgaon / Gurugram, India Talodyn Networks Private Limited Full timeDescriptionWe are looking for an experienced Big Data Engineer to join our team. The ideal candidate will have 5-8 years of experience in the job market in India and will be responsible for designing, building, and maintaining our big data infrastructure. The candidate should have strong technical skills and experience working with big data technologies such...
-
Big Data Engineer
6 months ago
Bengaluru, India Adobe Full timeOur Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...
-
Big data engineer
1 month ago
Bengaluru, India Mercedes-Benz Full timeTätigkeitsbereich:Forschung & Entwicklung incl. DesignFachabteilung:Data Analytics @ GCSPGesellschaft:Mercedes-Benz Research and Development India Private LimitedStandort:Mercedes-Benz Research and Development India, BangaloreStartdatum:..4Veröffentlichungsdatum:..4Stellennummer:MER3GEIArbeitszeit:Vollzeit BewerbenAufgaben · Mandatory: Deep hands-on...
-
Big Data Engineer 3
1 month ago
Bengaluru, Karnataka, India Oracle Full timeJob SummaryWe are seeking an experienced Big Data Engineer to join our team at Oracle. This role involves designing, developing, and troubleshooting large-scale data systems.Key ResponsibilitiesDesign and implement data processing pipelines using Big Data technologiesDevelop and maintain large-scale data storage systemsCollaborate with cross-functional teams...
-
Big Data Engineer/Architect
5 months ago
Bengaluru, India NETSACH GLOBAL Full timeGreetings from Netsach - A Cyber Security Company.Netsach is currently hiring Big Data Engineer/Architect is responsible for designing, developing, and maintaining large-scale data processing systems and architecture. This role involves working closely with data scientists, analysts, and other stakeholders to ensure data systems are scalable, secure, and...
-
Big Data Engineer Specialist
6 days ago
Bengaluru, Karnataka, India LTIMindtree Full timeLTIMindtree is a global leader in digital transformation consulting and technology services. We are seeking an experienced Big Data Engineer to join our team in Bengaluru, NCR Noida, Gurugram, or Delhi.The ideal candidate will have 5+ years of experience in working with big data technologies such as Pyspark, SQL, and Hive. The role involves designing,...
-
Big Data Engineering Expert
3 weeks ago
Bengaluru, Karnataka, India Walmart Global Tech India Full timeAbout the RoleWe are seeking an experienced Big Data Engineer to join our team at Walmart Global Tech India. As a key member of our engineering team, you will play a critical role in designing, building, and deploying cutting-edge big data solutions that drive business value for our customers.
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India LTIMindtree Full timeAbout UsLTIMindtree is a leading global technology consulting and services company, helping customers reimagine their businesses for the digital age. We have expertise in big data analytics.Job OverviewWe are seeking a skilled Data Engineer - Big Data Analytics to join our team. The successful candidate will be responsible for designing, developing, and...
-
Lead Big Data Engineer
3 weeks ago
Bengaluru, Karnataka, India GForce Consulting Solutions (OPC) Pvt. Ltd. Full timeSenior Software EngineerGForce Consulting Solutions (OPC) Pvt. Ltd., a leading global IT services company, is seeking an experienced Senior Software Engineer for our Multinational Client.About the RoleThis role involves working with our client to design and develop cutting-edge big data solutions using AWS Data Bricks, S3, Redshift, EC2, Lambda, Azure data...
-
Data Engineer for Big Data Pipelines
5 days ago
Bengaluru, Karnataka, India AppSierra Solutions Pvt Ltd Full timeWe are seeking a seasoned data engineer to lead the development and deployment of big data pipelines using AWS DataBricks.With 5-7 years of experience in software development on AWS, you will have strong hands-on knowledge of AWS DataBricks, DevOps, Kubernetes, and cloud services such as S3, Redshift, EC2, and Lambda. Additionally, you will have extensive...
-
Big Data Engineer
4 weeks ago
Bengaluru, India Eximietas Design Full time6+ yearsof experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience inJava● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of data...
-
Data Engineer
4 weeks ago
Bengaluru, India NTT DATA Full timeJob Description Req ID: 302683 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Off Shore) - Big ID to join our team in Bangalore, Karnātaka (IN-KA), India...
-
Big Data Engineer
5 months ago
Bengaluru, India Infogain Full timeBig Data Engineer (Standard) with skills Data Engineering, Data Warehouse, Big Data, databricks, Apache Spark, Azure Datalake, Pyspark for location Bangalore, India Posted on: July 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Advanced knowledge of Azure data services such as Azure SQL Database, Azure...
-
Big Data Engineer
4 weeks ago
Bengaluru, India Eximietas Design Full time6+ years of experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience in Java● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of...
-
Big data engineer
4 weeks ago
Bengaluru, India Eximietas Design Full time6+ years of experience in Big data engineering with a focus on data pipeline setup and management.● Strong development experience in Java● Hands-on experience with Kafka , S3, CDC, Spark, and SQL.● Proficient with container technologies like Docker.● Experience working in cloud environments and handling large datasets.● Solid understanding of...
-
Expert Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Wipro Full timeJob SummaryWe are seeking an Expert Big Data Engineer to join our team at Wipro. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark.About the RoleThis is a senior-level position that requires excellent knowledge of Spark, Scala, and PySpark. You...
-
Data Engineer
2 months ago
Bengaluru, India Coders Brain Technology Private Limited Full timeQualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...