Udemy - Senior Staff Software Engineer - Data Warehousing
3 weeks ago
Job Description :
Are you excited about building a Data Mesh platform on a global scale? Do you want to build a self-service, highly scalable platform to power Udemy's groundbreaking AI, ML, and data products? Udemy's Data org is looking for a self-driven, creative Data Mesh platform engineer passionate about changing the world by democratizing online education.
We are building highly available, scalable data infrastructure, services, tools, and libraries to serve critical data discovery, ML/data pipeline development & deployment, data security & compliance, and self-healing data operation needs.
Come join us and play a key role in developing and driving the adoption of our Data Mesh, data-centric micro-services, data engineering, and ML platform.
Responsibilities :
- Design, build, enhance, and support self-service data infrastructure as a platform, which would be used for Udemy's data mesh.
- Build robust, scalable, cloud-native, cost-optimized real-time and batch data integration pipelines in AWS with Airflow, Kafka, Databricks, Delta Lake, AWS services like S3, EMR, Athena, RDS, Redshift, EKS, etc., and Snowflake.
- Contribute towards Udemy's comprehensive data quality initiatives like data contracts, data validation, observability, and alerting
- Support data platform privacy with RBAC and encryption
- On-call rotation for business hours of data platforms with hundreds of data platform users
- 8+ years of experience in building distributed systems with Java, Scala, or Python
- 5+ years of experience managing big data platforms with storage (AWS S3), compute (AWS EMR or Databricks with Spark, AWS Athena or Presto), data warehouses (Redshift or Snowflake), streaming (Kafka or AWS Kinesis)
- 5+ years of experience in agile development methodologies & test-driven development (TDD)
- 5+ years of experience building and maintaining resilient real-time & batch data pipelines.
- Experience in building or using any one of the data quality tools (in-house built, SODA SQL, Anomalo, Monte Carlo, Great Expectations, or any other)
- Expertise in cloud data privacy tools in the area of authentication (AWS IAM/OKTA), encryption (AWS KMS/Safenet), authorization (Apache Ranger/Privacera)
- Strong grasp of object-oriented design patterns, algorithms, and data structures
- Good understanding of Data Mesh and Data Contract paradigm
- Experience with container systems (e.g., Docker) and container orchestration (e.g., ECS/EKS, Kubernetes)
- Active contributions to open-source projects are a plus
- Experience in ML Ops is a plus
- Experience in Terraform and Ansible
(ref:hirist.tech)
-
chennai, India Udemy Full timeJob Description : Are you excited about building a Data Mesh platform on a global scale? Do you want to build a self-service, highly scalable platform to power Udemy's groundbreaking AI, ML, and data products? Udemy's Data org is looking for a self-driven, creative Data Mesh platform engineer passionate about changing the world by democratizing online...
-
Chennai, Tamil Nadu, India Udemy Full timeJob Description :Are you excited about building a Data Mesh platform on a global scale? Do you want to build a self-service, highly scalable platform to power Udemy's groundbreaking AI, ML, and data products? Udemy's Data org is looking for a self-driven, creative Data Mesh platform engineer passionate about changing the world by democratizing online...
-
Chennai, India Udemy Full timeJob Description :Are you excited about building a Data Mesh platform on a global scale? Do you want to build a self-service, highly scalable platform to power Udemy's groundbreaking AI, ML, and data products? Udemy's Data org is looking for a self-driven, creative Data Mesh platform engineer passionate about changing the world by democratizing...
-
Chennai, India Udemy Full timeAbout this roleAre you excited about building a Data Mesh platform on a global scale? Do you want to build a self-service, highly scalable platform to power Udemy’s groundbreaking AI, ML, and data products? Udemy’s Data org is looking for a self-driven, creative Data Mesh platform engineer passionate about changing the world by democratizing online...
-
chennai, India Udemy Full timeAbout this role Are you excited about building a Data Mesh platform on a global scale? Do you want to build a self-service, highly scalable platform to power Udemy’s groundbreaking AI, ML, and data products? Udemy’s Data org is looking for a self-driven, creative Data Mesh platform engineer passionate about changing the world by democratizing...
-
Chennai, India Udemy Full timeAbout this role Are you excited about building a Data Mesh platform on a global scale? Do you want to build a self-service, highly scalable platform to power Udemy’s groundbreaking AI, ML, and data products? Udemy’s Data org is looking for a self-driven, creative Data Mesh platform engineer passionate about changing the world by democratizing...
-
Senior Staff Data ScientistChennai, India
2 weeks ago
Chennai, India Udemy Full timeAbout this roleAs a Senior Staff Data Scientist on the Globalization team, you will build scalable search algorithms fueled by machine learning, natural language processing and data-driven processes. You will create technical roadmaps to lead the technical vision of the Globalization team. You will collaborate with other Data Scientists, Product Managers and...
-
Senior Staff Data ScientistChennai, India
2 weeks ago
Chennai, India Udemy Full timeAbout this role As a Senior Staff Data Scientist on the Globalization team, you will build scalable search algorithms fueled by machine learning, natural language processing and data-driven processes. You will create technical roadmaps to lead the technical vision of the Globalization team. You will collaborate with other Data Scientists, Product...
-
Senior Staff Data ScientistChennai, India
2 weeks ago
chennai, India Udemy Full timeAbout this role As a Senior Staff Data Scientist on the Globalization team, you will build scalable search algorithms fueled by machine learning, natural language processing and data-driven processes. You will create technical roadmaps to lead the technical vision of the Globalization team. You will collaborate with other Data Scientists, Product...
-
Senior Partner EngineerChennai, India
1 day ago
chennai, India Udemy Full timeAbout this role Udemy is looking for a Senior Solution Engineerwith excellent communication and organization skills, knowledge and experience with software development practices and techniques, and a strong passion for helping businesses become modern “learning organizations”. The Solution Engineer will work closely with Udemy’s internal...
-
Solutions Engineer Chennai, India
12 hours ago
Chennai, India Udemy Full timeAbout this role Udemy is looking for a Senior Solution Engineerwith excellent communication and organization skills, knowledge and experience with software development practices and techniques, and a strong passion for helping businesses become modern “learning organizations”. The Solution Engineer will work closely with Udemy’s internal...
-
Senior Data ScientistChennai, India
2 weeks ago
Chennai, India Udemy Full timeAbout this roleAs a Senior Data Scientist on the Globalization team, you will build scalable search algorithms fueled by machine learning, natural language processing and data-driven processes. You will collaborate with other Data Scientists, Product Managers and engineers to improve Udemy’s search product. We have an exciting road map ahead of us and this...
-
Senior Data ScientistChennai, India
2 weeks ago
chennai, India Udemy Full timeAbout this role As a Senior Data Scientist on the Globalization team, you will build scalable search algorithms fueled by machine learning, natural language processing and data-driven processes. You will collaborate with other Data Scientists, Product Managers and engineers to improve Udemy’s search product. We have an exciting road map ahead...
-
Senior Data ScientistChennai, India
2 weeks ago
Chennai, India Udemy Full timeAbout this role As a Senior Data Scientist on the Globalization team, you will build scalable search algorithms fueled by machine learning, natural language processing and data-driven processes. You will collaborate with other Data Scientists, Product Managers and engineers to improve Udemy’s search product. We have an exciting road map ahead of us...
-
Wavicle Data Solutions
2 weeks ago
Chennai/Coimbatore, India Wavicle data solutions Full timeJob Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...
-
Senior Staff Software Engineer
3 weeks ago
Chennai, India MaxLinear Full timeResponsibilitiesMaxLinear is seeking a Senior Staff Software Engineer to join our growing team. In this role, you will focus on the following:Development of next generation wireless communications and broadband products like multi-gigabit Wi-Fi and broadband routers, mesh networks and distributed systems providing high speed data connectivityPre- and...
-
Senior Staff Software Engineer
4 weeks ago
Chennai, India MaxLinear Full timeResponsibilities MaxLinear is seeking a Senior Staff Software Engineer to join our growing team. In this role, you will focus on the following: Development of next generation wireless communications and broadband products like multi-gigabit Wi-Fi and broadband routers, mesh networks and distributed systems providing high speed data connectivity ...
-
Senior Staff Software Engineer
4 weeks ago
chennai, India MaxLinear Full timeResponsibilities MaxLinear is seeking a Senior Staff Software Engineer to join our growing team. In this role, you will focus on the following: Development of next generation wireless communications and broadband products like multi-gigabit Wi-Fi and broadband routers, mesh networks and distributed systems providing high speed data...
-
Senior Software Engineer
4 weeks ago
Chennai, India Rocket Software Full timeDescription Summary:The Senior Software Engineer designs, develops, troubleshoots, debugs, and sets the direction for the design and implementation of software features/functionality/enhancements, correction of defects, and/or the creation of new products. Develops software tools including operating systems, compilers, routers, networks, utilities,...
-
Senior Staff Software Engineer
4 weeks ago
Chennai, India FourKites, Inc. Full timeAt FourKites we have the opportunity to tackle complex challenges with real-world impacts. Whether it’s medical supplies from Cardinal Health or groceries for Walmart, the FourKites platform helps customers operate global supply chains that are efficient, agile and sustainable.Join a team of curious problem solvers that celebrates differences, leads with...
