Posts

Andrew Ng - Agentic AI talk

This is a good talk from Andrew on Agentic AI He packs a lot of info and ideas into this talk.  Andrew starts with his view that "AI is the new electricity" - because its a general purpose technology to allow building of new applications Andrew provides an overview of the current AI tech stack, but adds a new layer: an "agentic orchestration layer" applications: credo, woebothealth, workera, meeno etc. new agentic orchestration layer: langchain, crewai etc. models: openAi, anthropic, llama infrastructure: aws, google, azure chips: nvidia, amd etc. Most of the opportunity will be in building new AI applications (even though models are currently getting the most attention).  Andrew said he is "most excited" by Agentic AI (AI agents). Agentic AI is an automonous workflow which uses advanced reasoning to solve problems by reasoning, trial and error and iteration. "zero shot" when you ask a question and get back an answer e.g. original chatGpt. Agent...

what is creativity?

Creativity. You hear the word a lot. "the creative community". "creatives". The use of the word creatives has grown massively in the last 40 years. But what is creativity?  And what isn't creativity? Can creativity be learned? How are some people creative? How can I be more creative? I read "Creativity" from the Stanford Encyclopedia of Philosophy to help me answer these questions and thoroughly enjoyed it. These are my notes summarizing the document. What is and is not creativity The term "creative" can be applied to 3 kinds of things: person process or  product (where product can be an artifact, performance or idea (a tangible outcome)) One common definition of a creative product is if it's "new and valuable". Just being new is insufficient. The philosopher Kant defined as "original" and "exemplary". Which has become somewhat of a standard definition in psychology. "value" is debateable because f...

openAI o1 and "o1-mini" (aka strawberry)

 openAI o1 and "o1-mini" (aka strawberry) (as of end Sept '24) in preview, rate limited "50 queries per week for o1-preview and 50 queries per day for o1-mini." 'ChatGPT Plus" and "Team" users will be able to access o1 models in ChatGPT already. not in copilot yet , only a matter of time I assume notes: openAi trained these models to spend more time thinking through problems before they respond ...like a person would.  learned to refine their thinking process, try different strategies, and recognize their mistakes. o1 model update performs similarly to PhD students on challenging benchmark tasks in physics, chemistry, and biology.  enhanced reasoning capabilities may be particularly useful if you’re tackling complex problems in science, coding, math, and similar field for complex reasoning tasks this is a significant advancement and represents a new level of AI capability.  it doesn't just predict, it thinks o1 uses advanced reasoning tec...

copilot Enterprise features for pull requests

Update (end Sept 24): Enterprise features now coming to Business license  Big news PR summaries and copilot chat in github now coming to Business licenses  update Dec 2024: copilot PR feedback is in waitlist, expect G March 2025 copilot offers 3 subscription levels currently (August '24) Individual, Business and Enterprise ( see docs for details ) Enterprise adds some features such as PR Summaries, copilot chat in github.com, knowledgebase etc. only available in Enterprise. I'm especially interested in PR support. Done well I think it can be a "killer" feature of AI assistants (as well as test generation and code generation).  I want AI to be first reviewer of PRs. I want my AI PR reviewer to know all our coding standards, best practices, code conventions, be library aware, check security rules etc. and apply those in the PR. Be the first line of review. (yes, we get its input when writing the code, but PR review is a final checkpoint.) (yes, code linters etc can catc...

react batch updates (sometimes :-) )

reactjs will batch multiple state changes made in the same event handler and react waits until all code in the event handler has run before processing state updates. For example an onClick() handler may run multiple state updates. Instead of re-rendering after each individual state update in the handler, react batches them and renders once; after the handler completes (see example 1 below). This behavior is known as "batching" But an important thing to realize is: "React will not batch updates if they're triggered outside of a React event handler, like in a setTimeout()" This means that debounced handler functions will not be able to take advantage of react batching. But we want debounce and batching both! 😠 Ok, you want it, you got it 😀. Here are some options since react batching won't work: 1. in your handler, change from setting multiple useState setStates to 1 state update, this could be achieved using a useReducer or setting a complex object in a use...

Machine Learning notes for Andrew Ng on Coursera

Image
These are my personal notes for the " Machine Learning" Coursera course given by  Andrew Ng (ex Google Brain). I want to learn more and understand this domain better. Week 1 Topic 1 - Supervised vs Unsupervised machine learning Machine learning as the field of study that gives computers the ability to learn without being explicitly programmed Two main types of machine learning: 1. supervised learning - the data comes with both x input and y output regression: a type of supervised learning: to predict a number from infinitely many possible numbers  classification: another type of supervised learning: has a small finite number of outputs (categories) predicted 2. unsupervised learning - the data comes with inputs x but not y, algorithm has to find structure/pattern in the data clustering algorithm: takes data and groups into categories anomaly detection: dimensionality reduction: Supervised learning Regression supervised machine learning  Refers to algorithms that learn x t...