Drupal 11 development has reached a point where the system requirements are being raised in the development branch. To prepare core developers for this and to inform the community at large, we are announcing the following requirements for Drupal 11. … Drupal 11 will require PHP 8.3 and older versions of PHP are not supported. … The minimum database requirements for backends supported by Drupal 11 are MySQL 8.0 …
StarCoder2 – open source code completion models
StarCoder2 is a family of code generation models (3B, 7B, and 15B), trained on 600+ programming languages from The Stack v2 and some natural language text such as Wikipedia, Arxiv, and GitHub issues. The models use Grouped Query Attention, a context window of 16,384 tokens, with sliding window attention of 4,096 tokens. The 3B & 7B models were trained on 3+ trillion tokens, while the 15B was trained on 4+ trillion tokens. For more details check out the paper.
StarCoder2 is a family of open LLMs for code and comes in 3 different sizes with 3B, 7B and 15B parameters. The flagship StarCoder2-15B model is trained on over 4 trillion tokens and 600+ programming languages from The Stack v2. All models use Grouped Query Attention, a context window of 16,384 tokens with a sliding window attention of 4,096 tokens, and were trained using the Fill-in-the-Middle objective.
StarCoder2 offers three model sizes: a 3 billion-parameter model trained by ServiceNow, a 7 billion-parameter model trained by Hugging Face, and a 15 billion-parameter model trained by NVIDIA using NVIDIA NeMo on NVIDIA accelerated infrastructure:
Drupal and CKEditor: a history of advanced content editing | CKEditor
Explore the evolution of content editing in Drupal with CKEditor 5, uncover key features, real-world applications, and future plans.
Source: Drupal and CKEditor: a history of advanced content editing | CKEditor
Drupal 11 is now open for development, Drupal 10.3.x is branched
Starting today, the Drupal 11.x branch is used for building the next major Drupal version, Drupal 11. This means that major version specific changes can now happen on the Drupal 11.x branch. This includes dependency and requirements updates and removal of deprecated API and extensions. Details are available in the allowed changes during Drupal core release cycle document. Drupal 11 is planned to be released either on the week of June 17, week of July 29 or week of December 9, 2024, depending on when beta requirements are completed.
Source: Drupal 11 is now open for development, Drupal 10.3.x is branched
PC Magazine :: Don’t Run Out of Space: How to Move PC Games to a Different Hard Drive
If your hard drive is running out of space, you can move your collection of PC games to a different drive. Here’s how to set up the move from your game client of choice.
Source: Don’t Run Out of Space: How to Move PC Games to a Different Hard Drive
💥 Training Neural Nets on Larger Batches: Practical Tips for 1-GPU, Multi-GPU & Distributed setups | by Thomas Wolf | HuggingFace | Medium
Training neural networks with larger batches in PyTorch: gradient accumulation, gradient checkpointing, multi-GPUs and distributed setups…
Productionizing and scaling Python ML workloads simply | Ray
Scale your compute-intensive Python workloads. From reinforcement learning to large-scale model serving, Ray makes the power of distributed compute easy and accessible to every engineer.
Source: Productionizing and scaling Python ML workloads simply | Ray
Building a Multi-User Chatbot with Langchain and Pinecone in Next.JS
In this example, we’ll imagine that our chatbot needs to answer questions about the content of a website. To do that, we’ll need a way to store and access that information when the chatbot generates its response.
Source: Building a Multi-User Chatbot with Langchain and Pinecone in Next.JS
Mountpoint for Amazon S3 – Generally Available and Ready for Production Workloads | AWS News Blog
Mountpoint for Amazon S3 is an open source file client that makes it easy for your file-aware Linux applications to connect directly to Amazon Simple Storage Service (Amazon S3) buckets. Announced earlier this year as an alpha release, it is now generally available and ready for production use on your large-scale read-heavy applications: data lakes, machine learning training, image rendering, autonomous vehicle simulation, ETL, and more. It supports file-based workloads that perform sequential and random reads, sequential (append only) writes, and that don’t need full POSIX semantics.
— Mountpoint for Amazon S3 – Generally Available and Ready for Production Workloads
AudioCraft: A simple one-stop shop for audio modeling
AudioCraft is a simple framework that generates high-quality, realistic audio and music from text-based user inputs after training on raw audio signals as opposed to MIDI or piano rolls.
Source: AudioCraft: A simple one-stop shop for audio modeling