Write and deploy AWS Lambda functions with more confidence — Contents Introduction Tip #1: CPU power and memory scale proportionally Tip #2: Simplicity is a virtue Tip #3: Mind your concurrency Tip #4: Use native handling of partial batch failures Tip #5: Necessary runs only Tip #6: Avoid using AWS Lambda Conclusion References Introduction AWS Lambda is a highly scalable compute service…

Visually explore, tune, and select machine learning models — Contents Introduction Classification demo Conclusion References Introduction It is well known that data is a critical part of machine learning (ML) projects — especially, the data that is used as input to ML algorithms. However, there is also the data that gets generated during the model development process that gets a bit…

Contents Introduction Overview Configuring Time Travel Querying/cloning historical data/objects Undropping historical objects Conclusion References Introduction Snowflake is a cloud-based data warehouse similar to others such as Amazon Redshift and Google BigQuery. However, Snowflake differentiates itself quite a bit by supporting multi-cloud configurations, separation of storage and compute, fine-grained role-based access controls among…

Contents Introduction Prerequisite setup Create an Amazon S3 bucket Create a storage integration Create an external stage Create a stored procedure Schedule stored procedure execution using tasks Recovery Conclusion References Introduction Snowflake offers multiple layers of native data recovery features such as Time Travel and Fail Safe, which allow querying data…

I recently found myself needing to generate subsets of collections. In one situation I needed to generate all combinations of possibly interacting diseases (up to 6 diseases from a set of ~24 diseases) to diagnose a given set of symptoms. …

I have been doing a lot of infrastructure-as-code (IaC) work for my team, recently. We are heavy users of Amazon Web Services (AWS) and use Terraform as our main IaC tool. Over the past few weeks, I have spun up and torn down my fair share of AWS Lambdas using…

Contents Reverse Polish Notation (RPN) Example RPN expressions Source code Code walk-through Reverse Polish Notation (RPN) Reverse Polish notation (also known as postfix notation) is one of multiple notations for representing mathematical expressions. Most of us are familiar with infix notation, but there are also the less popular prefix and postfix notations. The most obvious…