Ho John Lee

The 7th workshop on Neural Scaling Laws is about to start: https://lnkd.in/gQSB5k8v Scaling laws, emergency, alignment, transfer learning, with a focused track on multilingual models. Looking forward to kick it off with Irina Rish and discuss all these topics with Yuhai Tu, Paul Bogdan, Hailey Schoelkopf, Darshil Doshi, Rio Yokota, Neha Sengupta, Preslav Nakov, Tatiana Shavrina, PhD, Yishi Xu. Join in person or virtually! #icml2024 #ai

34

A new world of trust evolves … as organisations must migrate their public key methods away from RSA, ECDSA, ECDH and EdDSA …

10

2 Comments

You don’t have to live in California to understand the implications of proposed California regulation SB 1407. Take a moment and read Andrew Ng’s latest post highlighting why this regulation is the wrong way to pursue AI safety.

11

Emerging technologies don’t simply materialize fully formed; they require the establishment of supply chains, the development of manufacturing processes, and the evolution of the technology itself. Along this journey, the cost incurred includes learning from the ten unsuccessful paths before arriving at the eleventh one that proves effective…a perceptive read if you are working in the Spatial Computing space

19

2 days ago California State Senate passed SB 1047, which establishes safety standards for AI developers of frontier models. A lot of the requirements directly demand guardrails that ZenGuard AI is developing. SB 1047 has far-reaching implications as it will inform other regulations in other states and countries. https://lnkd.in/dNSfJqun * All developers are strongly encouraged to follow safe, secure, and ethical AI development. The measures are (among others): pre-deployment safety testing, red-teaming, cybersecurity, safeguards to prevent the misuse of dangerous capabilities, and post-deployment monitoring. The goal is to set a community standard for safe, secure, and ethical AI development, that even smaller developers can adopt. * SB 1047 heavily targets its regulatory focus on "frontier" AI models requiring computing power greater than 10^26 floating-point operations that cost over $100 million to train. * The bill introduced CalCompute - a state-backed cloud computing cluster to democratize access to GPUs for smaller developers. In conjunction with the standards and guidelines in the bill, there is a clear motivation to adopt safety and security at the earliest stages of AI development for all developers. * This sets legal framework for attorneys to take legal action in the event the developer of a powerful AI harm or threat to the public safety.

17

4 Comments

Frontier 🧭 retains the #1 spot on the Top500! 💪 If you're interested in the back-story on the pre-exascale research that fed into this amazing machine, check out our retrospective paper from last year's #ISCA2023 conference (link below in the comments). ... And then stay tuned for the upcoming #ISCA2024 paper on the further evolution to MI300!

137

2 Comments

For Coloradans eager to understand the nuances of Elevate Quantum's bit Tech Hub win (!!!), this article is the best breakdown I've seen thus far. I'd not read anything by Ed Sealover before, but this is what it all boils down to. https://lnkd.in/gFfaiaZk

76

4 Comments

NVIDIA's acquisition of Deci AI is a perfect acknowledgement of the increasingly important role of model optimization to #AI deployment. #AI development and deployment is full of trade-off and neural networks architecture search (#nas) helps developers that are constantly to identify the most optimal AI model in a resource-constrained real world environment.

16

🌯 Today's dispatches from quantum: ⚆ Researchers from the Universität Innsbruck use diffusion models to generate quantum circuits for various applications ⚆ Zoom globally launches post-quantum end-to-end encryption for Zoom Meetings ⚆ UC Irvine scientists develop a method to create ultra-thin bismuth crystals for flexible quantum electronic devices ⚆ A framework for describing quantum many-body wave functions using network theory ⚆ A method for secure image transmission using quantum key distribution techniques ⚆ Theoretical framework identifies DNA as a perfect quantum computer through quantum physics principles ⚆ QNLP for the inverse design of metal-organic frameworks ⚆ MANY quantum jobs posted in the last 24 hours — Amazon Web Services (AWS), Google, Fermilab, Booz Allen Hamilton, The John Hopkins Applied Physics Laboratory, and Brookhaven National Laboratory. Get them while they're fresh! Plus, QSimulate’s QUELO-G and NVIDIA GPUs for rapid quantum mechanics-based simulations in drug discovery, “shortcut” density-functional theory with quantum algorithms for electronic-structure calculations, and World Economic Forum advises on quantum-resistant cryptographic methods for financial systems We're THE quantum computing newsletter, bringing you daily insights into the latest news & research. With leaders in academia, founders, and subscribers from top companies like Xanadu, SandboxAQ, and Qunnect, you're in good company. Join now at www.thedailyqubit.com and never miss a single qubit. #quantumcomputing #quantumphysics #innovation

7

A thoughtful commentary from Andrew on the importance of efficiency in deep models. We constantly oscillate back and forth between scaling up and scaling to product in the field of AI and ML, so it's not really a surprise, but generally speaking, cutting-edge AI has always been hard to price at the mass market value point -- and this has been true for half a century at this point. When building our virtual human models, we continuously worked on pushing quality and efficiency in a tick-tock cycle, which let us get to extreme efficiency in a short time. As we work to discover and deliver the value of AI, it is great to see many of the newest contenders focus on efficient delivery via both initial architecture and distillation approaches. I hope that more will pick up a cyclical improvement approach as well.

6

‘I Hope Suffering Happens To You’: Nvidia CEO’s Case For Hiring For Grit Over Pedigree by Jack Kelly Forbes “I wish you ample doses of pain and suffering.” That is the unconventional message NVIDIA CEO and founder Jensen Huang had for students at Stanford University, his alma mater, where he spoke last month at the Stanford Institute for Economic Policy Research. According to Huang, elite educational pedigrees alone are not necessarily the best predictor of success. “Greatness is not intelligence. Greatness comes from character. And character isn’t formed out of smart people, it’s formed out of people who suffered,” said the Stanford alum. Instead, the man who presides over one the world’s most valuable companies in terms of stock market valuation, now looks to find certain traits in job applicants that include resilience, grit and determination, which he contends lead to innovation and success in the workplace. Counterintuitively, Huang believes that having very high expectations coming out of an Ivy League education can potentially set people up for less resilience when faced with failure or adversity, which are inevitable in any career path. “Unfortunately, resilience matters in success,” he said to the students. “I don’t know how to teach it to you except for I hope suffering happens to you.” His comments indicate a view that real-world experience, involving struggles, obstacles and suffering, can instill the resilience needed for long-term success. Therefore, he believes that employers should look beyond just the prestige factor of a university and more closely at the inner drive, mindset and resolution of potential hires. “To this day I use the phrase ‘pain and suffering’ inside our company with great glee,” said the chief executive. “I mean that in a happy way, because you want to refine the character of your company. You want greatness out of them.” Hiring PHDs The Nvidia founder’s statements about valuing resilience over educational pedigrees align with the old Wall Street adage about hiring what they call “PHDs”—the poor, hungry and driven. The core parallels are prioritizing hunger, grit and motivation over academic credentials alone, believing that candidates who have had to overcome adversity, financial hardships or personal trauma offer invaluable drive and tenacity. The PHD concept essentially argues that struggle itself, if handled constructively, can be great preparation for thriving in ultra-competitive business environments where stamina and an insatiable work ethic are keys to success. A person who had to fight for opportunities may have a stronger inner drive and motivation to succeed compared to ... https://lnkd.in/e5XZitzS

4

2 Comments

Gift link for op-ed from the Editorial Board of the WSJ. We're in much agreement on this. From my perspective, more federal R&D should have been funneled towards safe and responsible AI all along, rather than reacting to winters and springs (consistency is key). Canada maintained a small investment through the last AI winter and it paid off nicely. It's one of the reasons they punch above their weight in AI today. We maintained our research efforts in KYield as well in a very lean manner, which is why I think we are still well ahead of the pack in our focus areas. But the idea that we need to suddenly invest $32 billion per year in non-mil AI is primarily buying votes in academic research across the country. Big Tech spends $220 billion a year in R&D. The primary problem is most of it is strategic to Big Tech, not customers or society. Monopolies want to force us to spend more GDP in their products -- they don't particularly care how, nor are they incentivized to care. However, as the piece suggests, spending has increased in all industries -- it's not at all just about Big Tech, despite the headlines. ~~~~~ If China is “going to invest $50 billion, and we’re going to invest in nothing, they’ll inevitably get ahead of us,” Mr. Schumer said Wednesday in unveiling a “roadmap” for AI policy with Republicans Mike Rounds and Todd Young and Democrat Martin Heinrich. Invest in nothing? Didn’t Washington pass massive climate, infrastructure and semi-conductor spending bills? "Mr. Schumer used the same justification in 2022 to pass the $280 billion Chips and Science Act, though China trailed the U.S. by years in semiconductors. Now President Biden is doling out money to chip makers at campaign stops, including $19.5 billion this spring for Intel at a chip plant in Arizona." "The Senate AI report calls for Congress to pass $32 billion a year in “emergency” spending for non-defense AI. What’s the emergency? Perhaps the November election."

4

2 Comments

Happy Quantum Day! 🎉 At iQrypto, we're celebrating by generating quantum-random numbers than you can say 'entanglement.' Here's to breaking the barriers of randomness...and maybe even reality. #QuantumDay #iQrypto #Quantum

11

I like this idea of "technical taste". It gets into where software engineering is as much creative art as it is science. Four great takeaways (IMHO) for software devs in this era in particular: 1. Aspiring engineers should cultivate a sense of curiosity, experiment with different tools and technologies, and embrace a mindset of continuous learning. 2. AI has the potential to streamline processes and enhance productivity for engineers, but it may also lead to disruptions in traditional software development workflows. 3. Developing technical taste and judgment is essential for making informed decisions about which technologies and approaches to pursue. 4. Collaboration and open-mindedness are key to leveraging the full potential of AI and staying ahead of technological advancements. I also really liked these two quotes from Sam Schillace: 1. "The right time to do something is when you have that feeling in the pit of your stomach that's like, 'oh, this is a great idea and it's going to suck to build because nothing's ready yet.'" 2. "Technical taste is like, 'how well have you consolidated that set of experiences and heuristics into judgment that you can apply accurately when you see new things?'" 3. "It may be the case that very small teams can do very large projects, or like we were talking about before, it may be the case we're just going to get really ambitious about what we try to do with the same size of teams, which is kind of where I would put my money." Great job on continuing to put out great episodes, Brett Berson and team First Round Capital! #ai #engineering #softwaredevelopment

5

Join me later today at the Data + AI Summit in San Francisco where I'll be speaking on Cleanlab's AI-powered data curation platform for AI and data improvement. Details below: This talk addresses the two biggest problems facing AI practitioners today: (1) reliability and (2) time/cost spent on high quality data and annotations. Curtis covers the theory and algorithms that enabled Cleanlab, the data curation platform for AI used by 100+ of the Fortune-500 companies to automate trust and improve data in their AI stack, to find and fix millions of errors in the top 10 most benchmarked ML datasets like MNIST, ImageNet, Dolly, and Amazon Reviews. Curtis shares lessons learned from ten years working with LLMs, ML, and AI solutions at companies like Google, Amazon, Meta, Oculus, and Microsoft and shares real-world industry examples of models improved, millions saved, and number of annotations needed reduced by as much as 98%. The solutions covered will be data and model-agnostic and domain-specific to arbitrary use cases enabling them to work for both current models and future models that haven't yet been invented, like GPT-6. Please stop by! Thank you to the fantastic team at Databricks whose hard work makes the conference run smoothly like Brian Dirking and Maria Pere-Perez. #dataaisummit #machinelearning #artificialintelligence #ai #ml #datacuration #datacentricai #llms #genAI #AGI

76

9 Comments

Open source has always been a major part of my career. I spent 13 years building MongoDB and its open source developer ecosystem, and at Viam all of the software that runs on a user's device, our APIs, and our SDKs are open source. Now, I am excited to share that Viam is now an official member of the Open Source Robotics Alliance. Let’s talk more about why open source is important to us:  Security - If machines are inside your house, your office, etc. security and privacy are paramount, and you'd want to know exactly what’s happening with that data. Open source not only makes companies responsible to write good software, but lets the community easily vet it. Innovation - I have said before, no one wants to contribute to a closed source ecosystem. We want developers to bring their ideas to life using Viam. To do so, open source is necessary, as it’s harder to contribute to closed source, and not nearly as rewarding. It keeps corporations in check - When betting your business on a technology, you are responsible for making sure there are some checks in place. By making everything on-machine open source, it means that if something happens, there are ways for users to move forward using open source without Viam. This is all just the tip of the iceberg. Open source has the power to democratize robotics, remove barriers to interoperability, and make automation much easier than it is today. Read more here: https://lnkd.in/eTc8p_Dk Open Robotics #opensource #openrobotics #viam #mongodb #robotics #opensourceroboticsalliance #OSRA

183

3 Comments

Nvidia, having surpassed tech stalwarts like Microsoft to become the world's most valuable company, is now at the center of an antitrust investigation by French regulators. This scrutiny aligns with the EU's rigorous enforcement of competition laws as regulators aim to preserve a fair market and safeguard consumer interests. As a trailblazer in AI, data centers, and autonomous vehicles, Nvidia's GPUs are central to advancements in AI and machine learning. However, their dominant market position has raised concerns over potential anti-competitive practices, potentially stifling competition. The forthcoming charges by the French authorities reflect a broader global trend of increased oversight of influential tech companies to prevent market monopolies. If found guilty, Nvidia could face hefty fines and operational restrictions that may hinder its competitive advantage. This situation mirrors wider regulatory actions against other tech giants, emphasizing the growing emphasis on harmonizing innovation with fair competition. Nvidia, aware of the cross-border regulatory interest, has acknowledged the increased scrutiny of its AI-related market position by authorities in the US, EU, China, and the UK. The company maintains that its practices are competitive and foster innovation, but the outcome of the French investigation and the potential for broader regulatory impacts remain to be seen.

4

1 Comment