Establish an architecture pattern and build data pipelines using Streamset to source structured, unstructured data from legacy sources and integrate with Snowflake Cloud platform. Hadoop to Snowflake migration streamlining.
Build data pipelines using Streamset Integration platform to integrate Transportation Management System with Snowflake.
Resolve issues with existing pipelines, refactor, rationalize and ensure pipelines are optimized for incremental load
Establish Data observability using Dynatrace, Snowflake metadata
Register data entities with Alation Data Catalog.
Metadata capture: data classification, data lineage, role-based access control (RBAC).
Review and align on Deliverables with Ross team.
Prepare demo on Alation Data Catalog features.
Must-have Skills
Individual contributor role, with Streamsets, Hadoop, Snowflake as Primary skills
Must have 5yrs of Retail industry experience. Someone who understands Supply chain, Transportation management system models, establish an Integration pattern.
Important Skillsets: Streamsets, Hadoop, Snowflake, DBT, Azure Infrastructure, AKS, 10+yrs of Retail Industry experience
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Engineering and Information Technology
Industries
Staffing and Recruiting
Referrals increase your chances of interviewing at Galaxy Infotech Inc. by 2x