Statistical Physics and Information Theory.pdf

《Statistical Physics and Information Theory.pdf》由会员上传分享，免费在线阅读，更多相关内容在学术论文-天天文库。

1、
RFoundationsandTrendsinCommunicationsandInformationTheoryVol.6,Nos.1–2(2009)1–212
c2010N.MerhavDOI:10.1561/0100000052StatisticalPhysicsandInformationTheoryByNeriMerhavContents1Introduction22BasicBackgroundinStatisticalPhysics82.1WhatisStatisticalPhysics?82.2BasicPostulate

2、sandtheMicrocanonicalEnsemble92.3TheCanonicalEnsemble182.4PropertiesofthePartitionFunctionandtheFreeEnergy222.5TheEnergyEquipartitionTheorem332.6TheGrand-CanonicalEnsemble353PhysicalInterpretationsofInformationMeasures403.1StatisticalPhysicsofOptimumMessageDistributions413

3、.2LargeDeviationsandPhysicsofCodingTheorems433.3Gibbs’InequalityandtheSecondLaw583.4Boltzmann’sH-TheoremandtheDPT743.5GeneralizedTemperatureandFisherInformation894AnalysisToolsandAsymptoticMethods964.1Introduction964.2TheLaplaceMethod984.3TheSaddle-PointMethod1024.4Extende

4、dExample:CapacityofaDisorderedSystem1124.5TheReplicaMethod1175InteractingParticlesandPhaseTransitions1235.1Introduction—SourcesofInteraction1245.2ModelsofInteractingParticles1255.3AQualitativeDiscussiononPhaseTransitions1315.4PhaseTransitionsoftheRate–DistortionFunction135

5、5.5TheOne-DimensionalIsingModel1395.6TheCurie–WeissModel1425.7SpinGlassesandRandomCodeEnsembles1476TheRandomEnergyModelandRandomCoding1526.1REMwithoutaMagneticField1526.2RandomCodeEnsemblesandtheREM1586.3RandomCodingExponents1657ExtensionsoftheREM1767.1REMUnderMagneticFiel

6、dandSource–ChannelCoding1777.2GeneralizedREM(GREM)andHierarchicalCoding1867.3DirectedPolymersinaRandomMediumandTreeCodes1978SummaryandOutlook202Acknowledgments204References205
RFoundationsandTrendsinCommunicationsandInformationTheoryVol.6,Nos.1–2(2009)1–212
c2010N.MerhavDO

7、I:10.1561/0100000052StatisticalPhysicsandInformationTheoryNeriMerhavDepartmentofElectricalEngineering,Technion—IsraelInstituteofTechnology,Haifa32000,Israel,merhav@ee.technion.ac.ilAbstractThismonographisbasedonlecturenotesofagraduatecourse,whichfocusesontherelationsbetwee

8、ninformationtheoryandstatisticalphysics.ThecoursewasdeliveredattheTechnionduringtheSpring