aster.cloud aster.cloud
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
aster.cloud aster.cloud
  • /
  • Platforms
    • Public Cloud
    • On-Premise
    • Hybrid Cloud
    • Data
  • Architecture
    • Design
    • Solutions
    • Enterprise
  • Engineering
    • Automation
    • Software Engineering
    • Project Management
    • DevOps
  • Programming
    • Learning
  • Tools
  • About
zednative_channels_winding-road_001
  • Technology

What’s Next (Maybe) For Generative AI, Foundation Models, Large Language Models, et al. v0.1.

  • Dean Marc
  • March 5, 2024
  • 4 minute read

The trajectory beyond Large Language Models (LLMs) involves advancements across technical, engineering, infrastructure, and global market dimensions. Looking into the future, several key areas are poised to shape the next wave of innovations in artificial intelligence (AI) and machine learning (ML). Disclaimer: As much as, you know, I can, I did not.


Technical And Engineering Innovations.

More Efficient Models.

While LLMs have grown in size, there is a push towards making AI models more efficient and environmentally sustainable. Techniques like (1) model pruning, (2) quantisation, and (3) knowledge distillation allow for smaller, faster models that maintain high performance levels.


Partner with aster.cloud
for your next big idea.
Let us know here.



From our partners:

CITI.IO :: Business. Institutions. Society. Global Political Economy.
CYBERPOGO.COM :: For the Arts, Sciences, and Technology.
DADAHACKS.COM :: Parenting For The Rest Of Us.
ZEDISTA.COM :: Entertainment. Sports. Culture. Escape.
TAKUMAKU.COM :: For The Hearth And Home.
ASTER.CLOUD :: From The Cloud And Beyond.
LIWAIWAI.COM :: Intelligence, Inside and Outside.
GLOBALCLOUDPLATFORMS.COM :: For The World's Computing Needs.
FIREGULAMAN.COM :: For The Fire In The Belly Of The Coder.
ASTERCASTER.COM :: Supra Astra. Beyond The Stars.
BARTDAY.COM :: Prosperity For Everyone.

Few-Shot And Zero-Shot Learning.

Advancements in few-shot and zero-shot learning, where models can understand and perform tasks with little to no training data, will reduce the dependency on large datasets and broaden AI applications.

Hybrid Models.

Combining the strengths of different AI approaches, such as symbolic AI with neural networks, to create hybrid models that can reason more effectively and explain their decisions.

Generalisable AI.

Moving towards models that can generalise across tasks without needing task-specific training, essentially making strides towards Artificial General Intelligence (AGI).


Infrastructure Developments.

Edge AI.

Increasing computational power at the edge (near or on the devices where data is generated) will allow for more real-time and privacy-preserving AI applications.

Distributed And Decentralised AI.

Technologies like blockchain could enable distributed AI models that operate in a decentralised manner, enhancing data privacy and security.

Advanced Neural Network Processors.

Development of specialised hardware and processors designed to efficiently run AI algorithms will continue, reducing costs and energy consumption.

Read More  Pick Your AI/ML Path On Google Cloud

Global Market Trends.

Democratisation Of AI.

Tools and platforms that make AI accessible to a wider range of users, including those without technical expertise, will continue to emerge, fostering innovation across various sectors.

Regulation And Ethics.

As AI becomes more integrated into society, the development of ethical guidelines and regulatory frameworks to govern its use will be crucial. This includes addressing biases in AI, ensuring transparency, and protecting user privacy.

AI In Emerging Markets.

AI adoption will accelerate in emerging markets, driving innovation in sectors like agriculture, healthcare, and education, and addressing unique challenges faced by these regions.

Cross-Industry Collaboration.

Increased collaboration across industries and disciplines will drive the development of more sophisticated and specialised AI applications, from healthcare diagnostics to climate change mitigation.


Looking Ahead

The evolution beyond LLMs will likely be characterised by a focus on efficiency, generalisability, and ethical considerations, alongside the technological advancements that enable these shifts. As AI technologies become more integrated into the fabric of daily life and global economies, the emphasis will also shift towards ensuring these technologies are used responsibly and for the greater good. The next phase of AI development will not just be about making models larger or more powerful, but about making them smarter, more sustainable, and accessible to a broader audience, with a keen eye on the societal implications of these advancements.


References:


Sanh, V., Debut, L., Chaumond, J. and Wolf, T., 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv preprint arXiv:1910.01108.

Lagunas, F., Malialis, K., Garijo, M. and Vrancx, P., 2021. Pruning Transformers with Trainable Sparse Masks. arXiv preprint arXiv:2104.14690.

Read More  Samsung And Google Cloud Join Forces To Bring Generative AI To Samsung Galaxy S24 Series

Brown, T.B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A. and Agarwal, S., 2020. Language models are few-shot learners. arXiv preprint arXiv:2005.14165.

Xian, Y., Lampert, C.H., Schiele, B. and Akata, Z., 2018. Zero-shot learning — A comprehensive evaluation of the good, the bad and the ugly. IEEE Transactions on Pattern Analysis and Machine Intelligence, 41(9), pp.2251-2265.

Mao, J., Gan, C., Kohli, P., Tenenbaum, J.B. and Wu, J., 2019. The neuro-symbolic concept learner: Interpreting scenes, words, and sentences from natural supervision. arXiv preprint arXiv:1904.12584.

Gupta, P., Gasse, M., Khalil, E.B., Kumar, P., Lodi, A. and Bengio, Y., 2020. Hybrid models for learning to branch. arXiv preprint arXiv:2006.15212.

Hospedales, T., Antoniou, A., Micaelli, P. and Storkey, A., 2020. Meta-learning in neural networks: A survey. arXiv preprint arXiv:2004.05439.

Pan, S.J. and Yang, Q., 2010. A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10), pp.1345-1359.

Satyanarayanan, M., 2017. The emergence of edge computing. Computer, 50(1), pp.30-39.

Lu, Y., Huang, X., Dai, Y., Maharjan, S. and Zhang, Y., 2020. Blockchain and federated learning for privacy-preserved data sharing in industrial IoT. IEEE Transactions on Industrial Informatics, 16(6), pp.4177-4186.

Jouppi, N.P., Young, C., Patil, N. and Patterson, D., 2017. In-datacenter performance analysis of a tensor processing unit. Proceedings of the 44th Annual International Symposium on Computer Architecture, pp.1-12.

Shneiderman, B., 2020. Bridging the gap between ethics and practice: Guidelines for reliable, safe, and trustworthy human-centered AI systems. ACM Transactions on Interactive Intelligent Systems, 10(4), Article 31.

Cath, C., Wachter, S., Mittelstadt, B., Taddeo, M. and Floridi, L., 2018. Artificial intelligence and the ‘good society’: the US, EU, and UK approach. Science and Engineering Ethics, 24, pp.505-528.

Read More  AMD Announces Expanded Consumer and Commercial AI PC Portfolio at CES

Aker, J.C. and Mbiti, I.M., 2010. Mobile phones and economic development in Africa. Journal of Economic Perspectives, 24(3), pp.207-232.

Davenport, T.H. and Ronanki, R., 2018. Artificial intelligence for the real world. Harvard Business Review, 96(1), pp.108-116.


For enquiries, product placements, sponsorships, and collaborations, connect with us at [email protected]. We'd love to hear from you!

Our humans need coffee too! Your support is highly appreciated, thank you!

Dean Marc

Part of the more nomadic tribe of humanity, Dean believes a boat anchored ashore, while safe, is a tragedy, as this denies the boat its purpose. Dean normally works as a strategist, advisor, operator, mentor, coder, and janitor for several technology companies, open-source communities, and startups. Otherwise, he's on a hunt for some good bean or leaf to enjoy a good read on some newly (re)discovered city or walking roads less taken with his little one.

Related Topics
  • AI
  • Artificial Intelligence
  • Generative AI
  • Intelligence
  • LLMs
  • Machine Learning
You May Also Like
View Post
  • Computing
  • Multi-Cloud
  • Technology

Reliance on US tech providers is making IT leaders skittish

  • May 28, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

Examine the 4 types of edge computing, with examples

  • May 28, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

AI and private cloud: 2 lessons from Dell Tech World 2025

  • May 28, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

TD Synnex named as UK distributor for Cohesity

  • May 28, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

Broadcom’s ‘harsh’ VMware contracts are costing customers up to 1,500% more

  • May 28, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

Weigh these 6 enterprise advantages of storage as a service

  • May 28, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

Pulsant targets partner diversity with new IaaS solution

  • May 23, 2025
View Post
  • Computing
  • Multi-Cloud
  • Technology

Growing AI workloads are causing hybrid cloud headaches

  • May 23, 2025

Stay Connected!
LATEST
  • 1
    Just make it scale: An Aurora DSQL story
    • May 29, 2025
  • 2
    Reliance on US tech providers is making IT leaders skittish
    • May 28, 2025
  • Examine the 4 types of edge computing, with examples
    • May 28, 2025
  • AI and private cloud: 2 lessons from Dell Tech World 2025
    • May 28, 2025
  • 5
    TD Synnex named as UK distributor for Cohesity
    • May 28, 2025
  • Weigh these 6 enterprise advantages of storage as a service
    • May 28, 2025
  • 7
    Broadcom’s ‘harsh’ VMware contracts are costing customers up to 1,500% more
    • May 28, 2025
  • 8
    Pulsant targets partner diversity with new IaaS solution
    • May 23, 2025
  • 9
    Growing AI workloads are causing hybrid cloud headaches
    • May 23, 2025
  • Gemma 3n 10
    Announcing Gemma 3n preview: powerful, efficient, mobile-first AI
    • May 22, 2025
about
Hello World!

We are aster.cloud. We’re created by programmers for programmers.

Our site aims to provide guides, programming tips, reviews, and interesting materials for tech people and those who want to learn in general.

We would like to hear from you.

If you have any feedback, enquiries, or sponsorship request, kindly reach out to us at:

[email protected]
Most Popular
  • Understand how Windows Server 2025 PAYG licensing works
    • May 20, 2025
  • By the numbers: How upskilling fills the IT skills gap
    • May 21, 2025
  • 3
    Cloud adoption isn’t all it’s cut out to be as enterprises report growing dissatisfaction
    • May 15, 2025
  • 4
    Hybrid cloud is complicated – Red Hat’s new AI assistant wants to solve that
    • May 20, 2025
  • 5
    Google is getting serious on cloud sovereignty
    • May 22, 2025
  • /
  • Technology
  • Tools
  • About
  • Contact Us

Input your search keywords and press Enter.