Erik on Software

Sign in Subscribe

Topic

data

A collection of 171 issues

Error in Official AWS Certified ML Specialty Exam Readiness Training

In working through the official AWS Certified Machine Learning Specialty Exam Readiness training, I spotted an error. Can you see it? 🙂 The formula for accuracy is incorrect. As can be seen at this link, it should actually be presented as follows: Accuracy = ( TP + TN ) / ( TP + TN + FP + FN ) A few

Community Comment: Part 5 - Unneeded dependencies slow down the software build effort

The comments I provided in reaction to a community discussion thread. Senior Data Analyst at UK marketing and advertising firm: A question to data science professionals: Do we need to learn every function of SQL out there? Or should we just focus on DML or should we also learn DDL,

Community Comment: Part 4 - To better enable commercial product comparisons, it's good practice to determine which (if any) open source products are being used by them

The comments I provided in reaction to a community discussion thread. Head of Artificial Intelligence at German consulting firm: This is how we have been building streaming data platforms five years ago. I'd like to have a discussion: how would you build such a thing in 2021? How

Community Comment: Part 3 - Everything is "possible", but not everything is "probable"

The comments I provided in reaction to a community discussion thread. Global Head of Innovative Data Science at Bayer: Yesterday, I published my vlog session, where I also discussed the contraposition between possibility and probability. Today I want to clarify this concept. In ordinary language, a thing is possible when

Community Comment: Part 2 - Delta Lake is recommended when the minimally compatible version of Spark is already being used

The comments I provided in reaction to a community discussion thread. Director of Data Analytics and Application Development: Some best practices for implementing cloud data lake: Cloud Data Lake Best Practices https://www.linkedin.com/pulse/cloud-data-lake-best-practices-jasmeet-singh/ Senior Solutions Architect at Databricks: Its interesting that you recommend using parquet on

Community Comment: Part 1 - Database products implement ACID differently, and "C" doesn't even belong in the acronym

The comments I provided in reaction to a community discussion thread. Software Engineer at Facebook: A lot of developers I talk to have trouble understanding database transactions and why they're incredibly useful. A transaction is a way to group several reads and writes into ONE logical unit. When

Media Query Source: Part 30 - DZone (US digital magazine); Executive insights on the state of databases

* DZone (US digital magazine) * Database effectiveness & the future of databases * Last couple years have experienced changing database landscape * One of 19 contributors to 9 key findings My responses ended up being included in a publication at DZone (July 9, 2019) for an article entitled "Executive Insights on the

Building a Data Platform on AWS from Scratch: Part 2

This article is the second in a multi-part case study series discussing the data platform my team and I built on AWS for the CIO of a Chicago-based global consultancy. As explained in the first part, one goal for this platform was to centralize data assets and data analysis across

Media Query Source: Part 28 - TechTarget (US digital magazine); Event streaming technologies a remedy for big data's onslaught

* TechTarget (US digital magazine) * Data streaming hurdles & best practices * Concepts challenging for traditional data pros * Greenfield use cases relatively less complex My responses ended up being included in an article at TechTarget (November 25, 2020). Extent of verbatim quote highlighted in orange, paraphrased quote highlighted in gray. Above image

Media Query Source: Part 27 - Built In (US startup community); The current state of Hadoop

The responses I provided to a media outlet on August 25, 2020: Media: The current state of Hadoop. Is it dead? Has its death been greatly exaggerated? Is it just for enterprises? How significant were/are Cloudera's 2019 stock woes? Where does Hadoop fit into the future of