Streaming Engineer
Acira Consultancy Pty Ltd

NORWEST 2153 - NSW
•5 hours ago
•No application
About
Software Engineer
Streaming Engineer with skills - Pyspark, kafka & Dynamo (with AWS a preferable)
Minimum of 10+ years of experience as a solution designer, developer, tester or support role in IT consulting or other technology business units across the industry
Minimum of 3+ years of hands-on development, testing and administration experience with Big data/data lake services in cloud on premise.
Experience in applying industry best practices, design patterns and first-of-a-kind technical solutions as developer or administrator on data and non-data specific platforms and applications.
Experience in implementing near real-time data flows/pipelines and distributed streaming applications using technologies such as pyspark, kafka & dynamo (with AWS preferable)
Experience in implementing traditional ETL, data warehousing and BI solutions
Hands-on development experience and working skill level in python, scalar, SQL, shell scripting and other programming/scripting languages
Hands-on implementation of services sensitive to performance SLAs with high availability, fault-tolerance, automatic fail-over and geographical redundancy.
Working knowledge and hands-on experience with cloud platforms such as Azure, AWS, GCP and IBM and other modern data platforms
Solid understanding of containerisation, virtualisation, infrastructure and networking
Diverse experience in software development methodologies and project delivery frameworks such as agile sprints, kanban, waterfall etc.
ITIL Function - Incident, Change, Problem
Ticketing tool experience. - Servicenow
Visa sponsorship available
Salary Package - 90-130K




