About the job

Willow is an established global start-up in rapid growth. The WillowTwin™ is a disruptive IoT/Data SaaS that unlocks the true potential of smart buildings and infrastructure. We are writing a new chapter in human history, with unprecedented resource optimisation and management empowered by data.For the second year in a row (2020 & 2021), Willow has been ranked in Linked In's Australian "Top 25 Start-ups". You will be joining a team of performance-driven individuals, backed by the most advanced technology the built world has ever seen. We are chartering a new course, Digital First, the Willow Way. Our 'Willow World' is fast-paced, nurturing and collaborative.Summary Of RoleAs our Senior Software Data Engineer, you will work on designing, developing, and maintaining scalable and efficient data pipelines, systems, and infrastructure. You will use your skills in Python(or other relevant languages such as Scala or C#) and experience with traditional and modern data warehousing to implement processes that ensure the quality and integrity of data. You will work with data scientists, software engineers, and other stakeholders to understand their data needs, provide technical guidance and contribute to the overall technical strategy of Willow.Role And ResponsibilitiesDesign, build and maintain data pipelines to ensure data quality, efficient processing, and timely delivery of accurate and trusted data. Apply data engineering techniques to implement product features around data ingestion, data quality, search & natural language processing. Continuously improve automation and infrastructure DevOpsEnsure performance, security, and availability of structured and semi-structured data stores.Work with Cybersecurity to ensure we are meeting ISO-27001 and SOC II, Type 2 requirements. consistent application of standard security policies.Skills And ExperienceStrong coding experience in Python (ideal) , Scala, Java, or C# Thorough understanding of modern data warehouse/data lake modeling.Experience building and optimizing data pipelines, architectures, and datasets in Microsoft Azure. Demonstrable experience implementing and optimizing both batch and streaming data pipelines.Commercial experience with Azure services, including Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Functions, Azure Key Vault, etc.Experience in developing automated build and deployment pipelines using YAML, ARM templates, and PowerShell.Advanced proficiency in writing complex SQL statements and manipulating large structured and semi-structured datasets.Expertise in performance tuning and troubleshooting.You should be an active learner, passionate about data and new technologies as well as comfortable recommending new and better ways to do things to the team.You need to be very comfortable collaborating with data analysts, data scientists, and software engineers as well as talking to product managers and other business stakeholders and explaining data concepts.Experience with Git or a similar version control/source code management tool.Attention to detail and strong problem-solving skills.Tertiary qualification in Computer Science or a similar relevant field.Role And Responsibilites

• Design, build and maintain data pipelines to ensure data quality, efficient processing, and timely delivery of accurate and trusted data.  Apply data engineering techniques to implement product features around data ingestion, data quality, search & natural language processing. Continuously improve automation and infrastructure DevOps
• Ensure performance, security, and availability of structured and semi-structured data stores.
• Work with Cybersecurity to ensure we are meeting ISO-27001 and SOC II, Type 2 requirements. consistent application of standard security policies.

Skills And Experience

• Strong coding experience in Python (ideal), Scala, Java, or C#
• Thorough understanding of modern data warehouse/data lake modeling.
• Experience building and optimizing data pipelines, architectures and datasets in Microsoft Azure.
• Demonstrable experience implementing and optimizing both batch and streaming data pipelines.
• Commercial experience with Azure services, including Azure Data Factory, Azure Databricks, Azure Data Lake, Azure Functions, Azure Key Vault, etc.
• Experience in developing automated build and deployment pipelines using YAML, ARM templates, and PowerShell.
• Advanced proficiency in writing complex SQL statements and manipulating large structured and semi-structured datasets.
• Expertise in performance tuning and troubleshooting.
• You should be an active learner, passionate about data and new technologies as well as comfortable recommending new and better ways to do things to the team.
• You need to be very comfortable collaborating with data analysts, data scientists, and software engineers as well as talking to product managers and other business stakeholders and explaining data concepts.
• Experience with Git or a similar version control/source code management tool.
• Attention to detail and strong problem-solving skills.
• Tertiary qualification in Computer Science or a similar relevant field.

Nice to have

• Practical experience with Snowflake cloud data warehouse is very highly regarded
• Experience with any of the BI reporting tools e.g., Power BI, Sigma, Qlik, Tableau.
• Working knowledge of Apache Spark and Databricks platform is a plus.
• Experience with Git or a similar version control/source code management tool is desired.
• Azure certification.

Benefits At WillowWe strive to have parity of perks & benefits across regions and while regulation differs from place to place, we believe that taking care of our people is the right thing to do.

• Flexible working arrangements
• Remote/hybrid working where applicable
• Competitive salary banding based on the work you do
• Career Learning & Development through Willow Academy (Education) Program
• Up to 3 days leave each year to use towards volunteer projects you love
• Employee Assistance Program
• Embracing parenthood with parental leave
• Medical insurance coverage (U.S and PH)
• 401K retirement plan (U.S)

If you are eager to work in a fast-paced, high-growth tech start-up based on collaboration and open communication, then Willow could be the place for you. See the life and culture here through the eyes of #PeopleofWillow As a distributed organisation, we value diversity in both backgrounds and experiences. Willow is proud to be an equal opportunity employer and is committed to making diversity, equity, and inclusion a part of everything we do. We believe that regardless of position or tenure, everyone is a leader. We at Willow never give up, we work smart, we care about our fellow human beings, and we always put our best foot forward. This translates to establishing an environment in which everyone can bring their real selves to work and make it easy for others to do the same.To find out more, visit the website: https://www.willowinc.com