aster.cloud aster.cloud
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
aster.cloud aster.cloud
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
zednative_channels_winding-road_001
  • Technology

What’s Next (Maybe) For Generative AI, Foundation Models, Large Language Models, et al. v0.1.

  • Dean Marc
  • March 5, 2024
  • 4 minute read

The trajectory beyond Large Language Models (LLMs) involves advancements across technical, engineering, infrastructure, and global market dimensions. Looking into the future, several key areas are poised to shape the next wave of innovations in artificial intelligence (AI) and machine learning (ML). Disclaimer: As much as, you know, I can, I did not.


Technical And Engineering Innovations.

More Efficient Models.

While LLMs have grown in size, there is a push towards making AI models more efficient and environmentally sustainable. Techniques like (1) model pruning, (2) quantisation, and (3) knowledge distillation allow for smaller, faster models that maintain high performance levels.


Partner with aster.cloud
for your next big idea.
Let us know here.



From our partners:

CITI.IO :: Business. Institutions. Society. Global Political Economy.
CYBERPOGO.COM :: For the Arts, Sciences, and Technology.
DADAHACKS.COM :: Parenting For The Rest Of Us.
ZEDISTA.COM :: Entertainment. Sports. Culture. Escape.
TAKUMAKU.COM :: For The Hearth And Home.
ASTER.CLOUD :: From The Cloud And Beyond.
LIWAIWAI.COM :: Intelligence, Inside and Outside.
GLOBALCLOUDPLATFORMS.COM :: For The World's Computing Needs.
FIREGULAMAN.COM :: For The Fire In The Belly Of The Coder.
ASTERCASTER.COM :: Supra Astra. Beyond The Stars.
BARTDAY.COM :: Prosperity For Everyone.

Few-Shot And Zero-Shot Learning.

Advancements in few-shot and zero-shot learning, where models can understand and perform tasks with little to no training data, will reduce the dependency on large datasets and broaden AI applications.

Hybrid Models.

Combining the strengths of different AI approaches, such as symbolic AI with neural networks, to create hybrid models that can reason more effectively and explain their decisions.

Generalisable AI.

Moving towards models that can generalise across tasks without needing task-specific training, essentially making strides towards Artificial General Intelligence (AGI).


Infrastructure Developments.

Edge AI.

Increasing computational power at the edge (near or on the devices where data is generated) will allow for more real-time and privacy-preserving AI applications.

Distributed And Decentralised AI.

Technologies like blockchain could enable distributed AI models that operate in a decentralised manner, enhancing data privacy and security.

Advanced Neural Network Processors.

Development of specialised hardware and processors designed to efficiently run AI algorithms will continue, reducing costs and energy consumption.

Read More  Built With BigQuery: How Tamr Delivers Master Data Management At Scale And What This Means For A Data Product Strategy

Global Market Trends.

Democratisation Of AI.

Tools and platforms that make AI accessible to a wider range of users, including those without technical expertise, will continue to emerge, fostering innovation across various sectors.

Regulation And Ethics.

As AI becomes more integrated into society, the development of ethical guidelines and regulatory frameworks to govern its use will be crucial. This includes addressing biases in AI, ensuring transparency, and protecting user privacy.

AI In Emerging Markets.

AI adoption will accelerate in emerging markets, driving innovation in sectors like agriculture, healthcare, and education, and addressing unique challenges faced by these regions.

Cross-Industry Collaboration.

Increased collaboration across industries and disciplines will drive the development of more sophisticated and specialised AI applications, from healthcare diagnostics to climate change mitigation.


Looking Ahead

The evolution beyond LLMs will likely be characterised by a focus on efficiency, generalisability, and ethical considerations, alongside the technological advancements that enable these shifts. As AI technologies become more integrated into the fabric of daily life and global economies, the emphasis will also shift towards ensuring these technologies are used responsibly and for the greater good. The next phase of AI development will not just be about making models larger or more powerful, but about making them smarter, more sustainable, and accessible to a broader audience, with a keen eye on the societal implications of these advancements.


References:


Sanh, V., Debut, L., Chaumond, J. and Wolf, T., 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108.

Lagunas, F., Malialis, K., Garijo, M. and Vrancx, P., 2021. Pruning Transformers with Trainable Sparse Masks. arXiv preprint arXiv:2104.14690.

Read More  Learning How To Learn

Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A. and Agarwal, S., 2020. Language models are few-shot learners. arXiv preprint arXiv:2005.14165.

Xian, Y., Lampert, C.H., Schiele, B. and Akata, Z., 2018. Zero-shot learning — A comprehensive evaluation of the good, the bad and the ugly. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41(9), pp.2251-2265.

Mao, J., Gan, C., Kohli, P., Tenenbaum, J.B. and Wu, J., 2019. The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision. arXiv preprint arXiv:1904.12584.

Gupta, P., Gasse, M., Khalil, E.B., Kumar, P., Lodi, A. and Bengio, Y., 2020. Hybrid models for learning to branch. arXiv preprint arXiv:2006.15212.

Hospedales, T., Antoniou, A., Micaelli, P. and Storkey, A., 2020. Meta-learning in neural networks: A survey. arXiv preprint arXiv:2004.05439.

Pan, S.J. and Yang, Q., 2010. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10), pp.1345-1359.

Satyanarayanan, M., 2017. The emergence of edge computing. Computer, 50(1), pp.30-39.

Lu, Y., Huang, X., Dai, Y., Maharjan, S. and Zhang, Y., 2020. Blockchain and federated learning for privacy-preserved data sharing in industrial IoT. IEEE Transactions on Industrial Informatics, 16(6), pp.4177-4186.

Jouppi, N.P., Young, C., Patil, N. and Patterson, D., 2017. In-datacenter performance analysis of a tensor processing unit. Proceedings of the 44th Annual International Symposium on Computer Architecture, pp.1-12.

Shneiderman, B., 2020. Bridging the gap between ethics and practice: Guidelines for reliable, safe, and trustworthy human-centered AI systems. ACM Transactions on Interactive Intelligent Systems, 10(4), Article 31.

Cath, C., Wachter, S., Mittelstadt, B., Taddeo, M. and Floridi, L., 2018. Artificial intelligence and the ‘good society’: the US, EU, and UK approach. Science and Engineering Ethics, 24, pp.505-528.

Read More  Using Machine Learning To Help ZSL & Network Rail Monitor And Improve Biodiversity Near British Railways

Aker, J.C. and Mbiti, I.M., 2010. Mobile phones and economic development in Africa. Journal of Economic Perspectives, 24(3), pp.207-232.

Davenport, T.H. and Ronanki, R., 2018. Artificial intelligence for the real world. Harvard Business Review, 96(1), pp.108-116.


For enquiries, product placements, sponsorships, and collaborations, connect with us at [email protected]. We'd love to hear from you!

Our humans need coffee too! Your support is highly appreciated, thank you!

Dean Marc

Part of the more nomadic tribe of humanity, Dean believes a boat anchored ashore, while safe, is a tragedy, as this denies the boat its purpose. Dean normally works as a strategist, advisor, operator, mentor, coder, and janitor for several technology companies, open-source communities, and startups. Otherwise, he's on a hunt for some good bean or leaf to enjoy a good read on some newly (re)discovered city or walking roads less taken with his little one.

Related Topics
  • AI
  • Artificial Intelligence
  • Generative AI
  • Intelligence
  • LLMs
  • Machine Learning
You May Also Like
View Post
  • Computing
  • Multi-Cloud
  • Technology

Pure Accelerate 2025: All the news and updates live from Las Vegas

  • June 18, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

‘This was a very purposeful strategy’: Pure Storage unveils Enterprise Data Cloud in bid to unify data storage, management

  • June 18, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

What is cloud bursting?

  • June 18, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

There’s a ‘cloud reset’ underway, and VMware Cloud Foundation 9.0 is a chance for Broadcom to pounce on it

  • June 17, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

What is confidential computing?

  • June 17, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

Oracle adds xAI Grok models to OCI

  • June 17, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

Fine-tune your storage-as-a-service approach

  • June 16, 2025
View Post
  • Technology

Advanced audio dialog and generation with Gemini 2.5

  • June 15, 2025

Stay Connected!
LATEST
  • 1
    Pure Accelerate 2025: All the news and updates live from Las Vegas
    • June 18, 2025
  • 2
    ‘This was a very purposeful strategy’: Pure Storage unveils Enterprise Data Cloud in bid to unify data storage, management
    • June 18, 2025
  • What is cloud bursting?
    • June 18, 2025
  • 4
    There’s a ‘cloud reset’ underway, and VMware Cloud Foundation 9.0 is a chance for Broadcom to pounce on it
    • June 17, 2025
  • What is confidential computing?
    • June 17, 2025
  • Oracle adds xAI Grok models to OCI
    • June 17, 2025
  • Fine-tune your storage-as-a-service approach
    • June 16, 2025
  • 8
    Advanced audio dialog and generation with Gemini 2.5
    • June 15, 2025
  • 9
    A Father’s Day Gift for Every Pop and Papa
    • June 13, 2025
  • 10
    Global cloud spending might be booming, but AWS is trailing Microsoft and Google
    • June 13, 2025
about
Hello World!

We are aster.cloud. We’re created by programmers for programmers.

Our site aims to provide guides, programming tips, reviews, and interesting materials for tech people and those who want to learn in general.

We would like to hear from you.

If you have any feedback, enquiries, or sponsorship request, kindly reach out to us at:

[email protected]
Most Popular
  • Google Cloud, Cloudflare struck by widespread outages
    • June 12, 2025
  • What is PC as a service (PCaaS)?
    • June 12, 2025
  • 3
    Crayon targets mid-market gains with expanded Google Cloud partnership
    • June 10, 2025
  • By the numbers: Use AI to fill the IT skills gap
    • June 11, 2025
  • 5
    Apple services deliver powerful features and intelligent updates to users this autumn
    • June 11, 2025
  • /
  • Technology
  • Tools
  • About
  • Contact Us

Input your search keywords and press Enter.